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I.  INTRODUCTION 

The  parallel  distributed  processing  structure  of  neural 
networks  provides  the  models  for  solving  adaptive  control 
problems,  as  demonstrated  in  Ref .  1.  Adaptive  control  involves 
a  self-learning  controller  which  has  the  ability  to  adjust 
itself  in  order  to  compensate  for  system  changes.  The  control 
and  estimation  functions  of  adaptive  control  will  be 
implemented  on  the  H2  and  H^  controllers  and  on  the  plant  of 
the  X-29  [Ref.  2] . 

Three  configurations  are  proposed  for  training  the  neural 
networks  to  provide  the  appropriate  inputs  to  the  X-29  plant 
in  which  desired  responses  are  obtained. 

This  thesis  will  investigate  the  applications  of  methods 
that  are  based  on  neural  network  adaptive  control  theory  to 
the  reduced  order,  linearized  longitudinal  dynamics  model  of 
the  X-29  aircraft.  Chapter  II  introduces  neural  network  theory 
and  the  backpropagation  algorithm.  In  Chapter  III,  two 
traditional  adaptive  control  methods  will  be  briefly 
discussed,  a  one-step-ahead  control  algorithm  will  be  used  to 
design  the  control  model,  and  a  linear  least  square  estimation 
algorithm  will  be  implemented  to  design  the  estimator  model. 
Chapter  IV  presents  a  description  of  the  fighter  as  well  as 
the  H2  and  Hro  controllers  that  were  designed  to  solve  the 


subsonic  longitudinal  instability  of  that  aircraft.  Chapter  V 
describes  the  hardware  and  software  used  for  the  experimental 
set-up,  in  addition  to  model  design  considerations  which 
include  design  objectives,  model  structures  selection,  and 
configurations.  Chapter  VI  presents  the  results  of  the  three 
configurations'  simulations.  Finally,  Chapter  VII  concludes 
with  some  remarks  on  what  has  been  achieved  and  what  is 
recommended  for  further  studies. 


II.  NEURAL  NETWORK  THEORY 

A.   ANALOGY  TO  THE  BRAIN 

Both  the  brain  and  the  digital  computer  operate  on 
electrical  signals,  perform  computational  functions  and  are 
composed  of  a  very  large  number  of  simple  elements.  The  major 
difference  is  in  the  signal  transmission  time  scale.  The 
computer  involves  microsecond  or  even  nanosecond  time  scales 
to  transmit  a  signal  compared  to  the  slow  nerve  impulses. 
Nevertheless,  the  advantage  of  the  brain  is,  that  its  huge 
computation  rate  is  achieved  by  an  enormous  amount  of  parallel 
units  which  surpass  any  modern  computer  system. 

Neural  network  elements  are  inspired  by  the  elementary 
functions  of  the  biological  neuron.  They  are  organized  in  such 
a  way  that  they  exhibit  some  characteristics  of  the  human 
brain.  That  is,  they  have  the  ability  to  learn  from 
experience,  to  perform  abstractions  of  inputs  with  relevant 
information,  and  to  generalize  their  knowledge  from  previous 
results. 

By  learning  we  mean  that  the  neural  network  can  modify  its 
behavior  from  the  environment's  response.  The  neural  network 
will  self-adjust  its  weights  to  produce  the  desired  output. 

By  abstraction  we  mean  the  ability  to  obtain  idealized 
prototypes  from  a  given  set  of  inputs. 


By  generalization  we  mean  that  the  neural  network  trained 
on  input  and  output  examples  can  produce  a  reasonable  output 
to  an  input  differing  from  those  it  was  trained  on. 

Figure  1  shows  the  typical  neuron.  The  neuron  consists  of 
three  sections:  the  dendrites,  the  cell  body,  and  the  axon. 
[Ref.  3] 
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Figure  1  Biological  Neuron 


The  dendrites  receive  signals  from  other  neurons  through 
the  synapses,  the  connection  points.  These  inputs  are 
multiplied  by  the  corresponding  weight,  the  synapse  strength, 
and  then  summed  in  the  cell  body  to  determine  if  their 
excitation  level  exceeds  the  specified  threshold.  On  the 
affirmative,  the  cell  fires  and  sends  a  signal  to  the  other 
neurons  through  the  axons. 


B.   NEURAL  NETWORK  ARCHITECTURE 

In  a  neural  network,  we  refer  to  the  neuron  as  a 
processing  element,  PE.  As  shown  in  Fig.  2,  the  input  paths 
are  comparable  to  the  dendrites,  the  summation  operation  and 
the  transfer  function  to  the  cell  body,  and  the  output  paths 
to  the  axon.  [Ref.  4] 
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Figure  2  Building  Blocks  of  Neural  Computing  Network 


1.   Processing  Elements 

A  processing  element  is  a  simple  computational  unit 
which  receives  data  from  its  input  side,  processes  that  data 
through  a  summation  operation  and  a  transfer  function,  and 
then  sends  the  result  to  the  neighboring  processing  elements 
from  its  output  side.  Figure  3  represents  a  simple  neural 
network  architecture.  Many  processing  elements  are  grouped 
into  layers  and  are  either  fully  or  randomly  connected  to  the 


processing  elements  of  the  successive  layers.  These 
connections  determine  in  what  manner  the  processing  elements 
will  react  with  each  other. 

The  neural  networks  for  this  research  consist  of 
feedforward  networks  in  which  the  connections  feed  the 
information  in  only  one  direction.  No  recurrent  layers  or 
feedback  loops  from  a  processing  element  to  a  previous  one 
will  be  considered. 
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Figure  3  A  Simple  Neural  Network  Architecture 

The  first  layer  is  the  input  buffer,  which  presents 
the  information  to  the  network.  The  last  layer  is  the  output 
buffer,  which  contains  the  response  of  the  network  to  the 
given  input.  Intermediate  layers  are  referred  to  as  hidden 
layers. 


Referring  to  control  theory  in  state  space,  the  input 
buffer  elements  correspond  to  the  elements  of  the  input 
variable,  the  output  buffer  elements  to  the  ones  of  the  output 
variable,  and  the  hidden  units  to  the  elements  of  the  state 
variable. 

At  any  given  time,  each  processing  element  has  a 
certain  level  of  activation.  The  pattern  and  the  level  of 
these  activations  determine  the  state  of  the  system  at  that 
given  point. 

2.   Activation  function  Logic 

Neuralworks  Professional  11/  Plus®  development 
software  contains  an  activation  function  logic,  shown  in  Fig. 
4,  which  demonstrates  the  complexity  of  the  activation 
function  of  the  system.  The  use  of  complex  activation 
functions  may  help  the  network  to  solve  various  nonlinear 
systems.  Activations  may  include  a  summation  function,  a 
transfer  function,  a  noise  generator,  scaling,  limiting, 
thresholding,  and  an  output  function.  [Ref.  4] 

The  transfer  function  could  be  simply-  a  linear,  or 
some  monotonic  function  like  the  sigmoid  and  hyperbolic 
tangent  functions.  A  nonlinear  network  can  be  achieved  by 
using  any  of  the  last  two  functions  since  they  provide 
nonlinear  responses. 
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The  sigmoid  function,  as  shown  in  Fig.  5,  is  a 
logistic  or  "squashing"  function.  NET  is  equivalent  to  x  in 
the    following  notation. 
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(LOGISTIC    FUNCTION) 


Figure   5   Sigmoidal   Logistic   Function 


The  sigmoid  function  is  expressed  as, 

OUT  =   1    /    (l+e~x)  (2.1) 

Its  derivative  can  be  simply  represented  in  terms  of  itself, 

OUT'    =   e~x/ (l+e~x)2 
or  OUT' (x)    =  out(x)*(l-out(x) )  (2.2) 

which  saves  a  large  amount  of  computation  time.  Equation  (2.2) 
defines  a  nonlinear  gain  that  solves  the  noise-saturation 
dilemma  of  Grossberg  (1973);  that  is,  it  permits  the  network 
to  handle  both,  small  and  large  signals.  The  central  region  of 
high  gain  helps  the  small  input  signals  to  be  processed,  while 
the  decreasing  slope  or  gain  at  both,  negative  and  positive 
extremes,  are  adequate  for  large  signals. 

Another  nonlinear  activation  function  which  is  often 
used  is  the  hyperbolic  tangent  function  shown  in  Fig.  6.  It  is 
expressed  as  follows: 

OUT  =  tanh(x)      or  OUT   =  (ex-e~x)  /  (ex+e~x)  (2.3) 


Figure  6  Hyperbolic  Tangent  Function 

As  with  the  sigmoid  function,  its  derivative  can  also  be 
expressed  in  terms  of  itself: 


OUT' (x)    =    (l+out(x) )* (l-out(x) ) 


(2.4) 


3.   Learning  rule 

There  are  two  distinct  phases  in  the  operation  of  the 
network:  learning  and  recall.  Three  types  of  learning  exist: 
supervised,  unsupervised,  and  reinforcement. 

Supervised  learning  involves  modifying  the  connection 
weights  in  response  to  a  desired  output  presented  to  the 
network  corresponding  to  a  given  input.  In  this  thesis,  the 
generalized  delta  learning  rule  was  selected  to  reduce  the 
error  between  the  actual  and  desired  output  of  a  processing 
element. 

If  the  network  is  not  given  any  desired  output,  an 
unsupervised  learning   process  applies.  The  network  forms 
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groups  of  similar  input  patterns,  where  each  processing 
element  responds  strongly  to  different  groups. 

Self-supervised  learning   falls  between  the  supervised 
and  the  unsupervised  learning.  The  network  will  determine  its 
own  desired  solution  and  trains  itself  accordingly. 
4.   Recall  rule 

Recall  is  a  simple  feedforward  network  where  no 
learning  takes  place,  i.e.,  no  feedback  between  layers.  An 
input  is  presented  to  the  network,  the  information  is 
propagated  forward  through  the  different  layers,  and  an  output 
is  obtained.  It  is  a  straightforward  process,  where  only  the 
summation  operation  and  the  transfer  function  apply.  It  is  an 
integral  part  of  the  testing  process  which  compares  the 
desired  and  the  actual  output  of  the  network  to  determine  the 
current  error. 

C.   BACK-PROPAGATION  ALGORITHM 

The  supervised  learning  rule  and  the  back-propagation 
algorithm  were  chosen  for  the  networks  of  this  investigation. 
Back-propagation  has  a  particular  way  of  handling  errors.  It 
distributes  the  error  by  propagating  the  output  error  backward 
through  the  connections  of  the  previous  layers. 

When  the  signal  is  fedforward  from  the  input  to  the 
output,  the  error  between  the  desired  and  actual  output  is 
obtained.  This  error  is,  then,  multiplied  by  the  derivative  of 
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the  transfer  function,  and  backpropagated  from  the  input  to 
the  output  layer  to  adjust  or  update  the  connections'  weight. 

The  typical  neural  network  using  the  back-propagation 
algorithm  is  best  represented  with  an  input  layer,  an  output 
layer,  and  at  least  one  hidden  layer  using  a  monotonic 
activation  function.  [Ref.  4:pp.  NC112] 

For  a  better  understanding  of  the  next  sections,  a  clear 
notation  is  necessary.  The  superscript  in  brackets  symbolizes 
the  layer  being  considered, 

X^[s]  :  current  output  state  of  jth  neuron  in  layer  s, 
W:ji[s]:  weight  on  connection  joining  ith  neuron  in  layer 

s-1   to  jth  neuron  in  layer  s, 
Ij[s]  :  weighted  summation  of  inputs  to  jth  neuron  in 

layer  s. 

1.   The  Global  Error  Function 

The  learning  process  has  the  aim  of  minimizing  the 
global  error,  E,  by  adjusting  the  weights  in  the  network. 
Therefore,  the  measure  of  the  global  error,  E,  is  achieved  by 
subtracting  the  desired  output  d  by  the  actual  output  o,  as 
follows: 

E   =  0.5*SCrdJ-oJ>)2;  (2.5) 

where  the  term  in  parentheses  is  the  raw  local  error.  The 
global  error  function,  E,    is  also  a  dif f erentiable  function  of 
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all  connection  weights  in  the  network.  The  derivative  of  E 
with  respect  to  I   gives, 

ejs)   =   -dE/dl-t*]  (2.6) 

The  raw  local  error  of  equation  (2.5)  is  scaled  by  multiplying 
it  by  the  derivative  of  the  transfer  function,  or 

ej   =  -dE/dll*]  (2.7) 

=  -(dE/doj)*(doj/dlj) 

=     (dj-OjJff  (Ij) 

The  scaled  local  error,  which  is  backpropagated,  will  be 
stored  in  each  processing  element  in  its  error  field. 

A  gradient  descent  rule  is  used  to  determine  if  an 
increment  or  decrement  of  the  current  weights,  W±JS^  t  is 
favorable  to  reduce  the  global  error.  The  result  by  using  the 
chain  rule  and  equation  (2.6)  is, 

dE/dWjJ3!   =  (dE/dljl5!  )*  (dijt5]  /dWjJ5] )  (2.8) 

=  -e  Js]*x  -I5'1! 

The  gradient  descent  rule  used  is, 

Awji[S]  =  -lcoef*(dE/dwjiIsl)  (2.9) 


13 


where  lcoef   is  the  learning  coefficient  or  rate. 
Combining  equations  (2.8)  and  (2.9)  gives, 

Awj±tsl   =  lcoef*ej[sl*x1[s-1]  (2.10) 

The  error  signal,  e  Js^ ,    of  the  above  equation  is  applied  only 
to  the  elements  of  the  output  layer. 

As  to  the  elements  of  the  hidden  layers  which  do  not 
have  any  desired  output,  e  ^  is  expressed  as  the  derivative 
of  the  transfer  function  multiplied  by  the  error  and  the 
weights  backpropagated  from  the  previous  layer,  or 

e.[s]   =  f ,  (Ijsj)it7.k(ek[8+ijitWkJs+l])  (2.11) 

2 .   Back-propagation  Summary 

The  input  layer  will  be  presented  with  some  data  which 
the  network  will  propagate  in  a  straightforward  sense 
(feedforward)  to  the  output  layer.  At  the  same  time,  all  the 
summed  inputs,  I[s],  and  output  states,  x_[s],  will  be  set 
for  each  processing  element. 

For  the  output  layer,  the  scaled  local  error  from 
equation  (2.7)  and  the  delta  weight  of  equation  (2.10)  will  be 
calculated  for  each  of  its  processing  elements. 

For  the  hidden  layers,  the  scaled  local  error  will  be 
calculated  using  equation  (2.11)  and  the  delta  weight  using 
also  equation  (2.10). 
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An  update  of  all  the  weights  will  be  performed  by 
adding  these  delta  weights  to  their  corresponding  previous 
weights.  [Ref.  4:pp.  NC116] 
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III.    ADAPTIVE  CONTROL  SYSTEMS 

An  adaptive  controller  is  one  in  which  the  control  system 
has  the  ability  to  adjust  itself  in  order  to  compensate  for 
some  changes  in  the  system's  parameters  and  environment. 
Adaptive  control  is  divided  into  two  functions:  a  control 
function  and  a  model  estimation  function. 

The  design  of  an  adaptive  control  system  can  be 
conceptually  simple  when  combining  a  particular  parameter 
estimation  technigue  with  any  control  law. 

In  this  chapter,  two  traditional  adaptive  control  methods 
will  be  briefly  discussed,  a  one  step  ahead  control  algorithm 
will  be  used  to  design  the  control  model,  and  a  linear  least 
square  estimation  will  be  implemented  with  a  recursive  least- 
squares  algorithm  to  produce  a  predictor-corrector  equation 
used  to  design  the  estimator  model. 

A.   TWO  TRADITIONAL  ADAPTIVE  CONTROL  METHODS 

There  are  two  traditional  adaptive  control  methods  that 
are  of  interest  to  neural  network  control  theory:  the  self- 
tuning  regulator  of  Astrom  (STR)  and  the  Lyapunov  model 
reference  adaptive  control  (MRAC) .  The  self-tuning  regulator 
block  diagram  is  shown  in  Fig.  7.  It  is  a  classical  feedback 
system  with  on-line  adjustable  coefficients.  [Ref.  5] 
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Figure  7  Self-Tuning  Regulator  Control  Block  Diagram 

For  the  approximation  of  the  model  that  describes  the 
system  being  controlled,  a  least  squares  error  parameter 
identification  technique  is  used.  The  regulator  parameters  are 
adjusted  during  each  control  cycle  according  to  the  best 
estimate  of  the  system  parameters. 

With  this  method,  the  stability  of  the  system  is  not 
always  guaranteed.  During  the  learning  phase  the  input  signal 
can  become  infinitely  large,  thus  the  model  is  not  realizable. 
If  the  least-squares  error  parameter  estimates  do  not  match 
entirely  the  description  of  the  system,  the  closed-loop  system 
performance  will  not  satisfy  the  design  specifications. 

The  second  adaptive  control  method  is  the  Lyaponuv  model 
reference  adaptive  control  (MRAC) ,  shown  in  Fig.  8.  The  system 
is  forced  to  follow  a  reference  model.  [Ref.  5] 
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The  regulator  consists  of  two  loops,  an  inner  and  an  outer 
loop.  The  inner  loop  is  a  feedback  loop  composed  of  the 
regulator  and  the  plant. 


Model 


Regulator  Parameters 


Regulator 


Adjustment 
Mechanism 


Plant 


Figure  8  Model  Reference  Adaptive  Control  Block  Diagram 

The  outer  loop  is  also  a  regulator  loop.  It  adjusts  the 
parameters  of  the  regulator  by  minimizing  the  error  between 
the  plant  output  y  and  the  model  output  ym.  Therefore,  the  aim 
is  to  determine  the  adjustment  mechanism  so  that  the  system 
being  controlled  tracks  perfectly  the  reference  model  with 
zero  error. 

The  latter  type  of  adaptive  controller  will  be  emphasized 
in  this  thesis. 
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B.   ONE  STEP  AHEAD  PREDICTION  CONTROL 

The  first  function  of  adaptive  control  is  control.  The 
one-step-ahead  controller  is  a  very  simple  form  of  a  control 
law.  The  basic  idea  is  that  the  control  input  at  each  point  in 
time  is  determined  so  as  to  bring  the  output,  y(t+d)  (where  d 
represents  a  time  delay),  to  a  desired  output  value,  y* (t+d) , 
in  one  step.  This  controller  works  not  only  for  linear  systems 
but  also  for  a  large  class  of  nonlinear  systems  [Ref.  6:pp. 
118-122]  . 

The  input-output  properties  of  the  system  can  be  described 
by  three  equivalent  model  formats:  a  left  difference  operator 
representation,  an  observable  state-space  model,  or  a  DARMA 
(discrete  time  deterministic  autoregressive  moving  average) 
model  [Ref.  6:p.  120],  The  simplest  to  use  for  the  development 
of  adaptive  control  algorithms  is  the  (DARMA)  model.  That 
model  can  be  expressed  as, 

A(q)y(t)    =  B(q)u(t)  where  (3.1) 

Afq-1)    =   I+A1(q)  +  ...+An(q)      ' 
Bfq'1)    =  B0+...+Ba(q) 

where  A(q)  and  B  (q)  are  matrix  polynomials  expressed  in  terms 
of  the  backward  shift  operator,  q~l ,  the  system  output,  y(t), 
and  the  system  input,  u(t)  .  The  terms  in  the  past  values  of  y 
are  the  autoregressive  components  and  the  terms  in  the  past 
values  of  u   are  the  moving-average     components.  A  DARMA  model 
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can  be  compared  to  a  controllable  and  observable  state-space 
model  with  an  arbitrary  initial  state,  or  simply  a  transfer 
function.  [Ref.  6:p.  32] 

Rearranging  equation  (3.1)  by  expanding  a  single  input 
single  output  (SISO)  DARMA  model  in  the  shift  operator  gives, 

y(t)  =  b1u(t-l)+b2u(t-2)+. . .-a1y(t-l)-a2y(t-2) .  .  .  (3.2) 

which  can  be  used  to  predict  the  output  at  the  next  time  step, 

y* (t+1)   =  b1u(t)+b2u(t-l)  +  . . .-a1y(t)-a2y(t-l)  .  .  .  (3.3) 

where  y* (t+1)  is  the  predicted  value  of  y(t+l).  The  control 
input,  u(t) ,  of  equation  (3.3),  which  brings  the  system  to  a 
desired  value  y* (t+1)    in  one  step,  can  be  solved  as  follows: 

u(t)    =  l/b1    [y*  (t+l)+a1y(t)+a2y(t-l)  +  .  . . 

-b2u(t-l) . . .]  (3.4) 

where  the  term  y*  (t+1)  could  be  some  reference  input  to  the 
system  [Ref.  l:p.  19]. 

The  one  step  ahead  prediction  control  law  equation  (3.4) 
minimizes  the  quadratic  cost  function  comprising  the  squared 
prediction  error: 

J(t)    =  1/2    [y (t+1) -y* (t+1)]2  (3.5) 

20 


Excessive  effort  may  be  required  to  bring  y(t+l)  to 
y*  (t+1)  in  one  step.  Therefore,  some  generalized  cost 
functions  of  the  same  form  like  the  weighted  one-step-ahead 
controller  [Ref.  6:p.  122],  described  below,  could  achieve  a 
compromise  between  the  level  of  effort  expended  and  the 
prediction  error. 

If  the  past  values  of  y(t)  and  u(t)  are  state  variables, 
the  one  step  ahead  controller  becomes, 

u(t)    =  K(t)x(t)+r(t)  (3.6) 

which  is  a  state  variable  feedback  with  r(t)  as  the  reference 
input  controller.  From  equation  (3.4),  the  vector  of  past 
outputs  and  inputs  provides  the  state  variables  in  equation 
(3.6)  which  in  turn  provides  a  controller  for  an  adaptive 
algorithm  [Ref.  6:pp.  120-170].  This  one  step  ahead  controller 
could  easily  be  modified  to  represent  a  weighted 
sum  of  state  variables  and  a  reference  input,  i.e.,  a  weighted 
one-step-ahead  controller, 

u(t)    =  Ei  Wlj*Nj(t)  (3.7) 

where  Nj(t)=[   r(t)    u(t-l)    u (t-2) . . . -y (t)    -y(t-l)    -y(t-2)...] 

As  mentioned  in  the  chapter  of  neural  network  theory,  the 

input  to  a  processing  element  is  defined  as  the  weighted  sum 

of  all  the  element  activations  coming  to  its  input,  as  shown 
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in  Fig.  2.  Therefore,  a  direct  comparison  could  be  made 

between  the  two  previous  statements,  in  that  this  form  of 

controller   may   well   be   represented   by   neural  network 
processing  elements. 

C.   LINEAR  LEAST  SQUARE  ESTIMATION 

The  second  function  of  adaptive  control  is  estimation.  On- 
line estimation  techniques  provide  estimates  for  the  system 
parameters  based  on  minimizing  the  quadratic  cost  functions  as 
in  the  case  of  a  one-step-ahead  controller. 

The  input-output  characteristics  of  many  linear  and 
nonlinear  deterministic  systems  may  be  described  by  the 
following  model  [Ref.  6:p.  50]: 

y(t)    =  N(t-1)6T  (3.8) 

where   y(t)         denotes  the  system  output 

N(t-l)    denotes  a  regression  vector  containing  past 

measurements  of  the  input  and  output, 
6  denotes  a  parameter  vector. 

A  first  order  DARMA  model  can  be  represented  by  [Ref.  6:p. 
50], 

y(t)    =  Z  bjuft-j)-   E  aky(t-k)  (3.9) 
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where  j  and  k  are  indices  for  past  input  and  output 
measurements.  Equation  (3.9)  can  be  expressed  in  the  form  of 
equation  (3.8)  as  follows: 

N(t-l)   =  [u(t)   u(t-l)   u(t-2) . . .-y(t-l)-y(t-2) . . .]       (3.10) 
6  =    [b1b2b3. . .axa2a3]  (3.11) 

With  equation  (3.9)  the  prediction  error  becomes, 

e(t,6)    =  y(t)-N(t-l)0T  (3.12) 

where  e  is  used  in  the  quadratic  cost  function  to  determine 
some  optimal  value  for  6    [Ref.  7:pp.  176-179], 

J(6)    =  1/2   Zt[e]2  (3.13) 

where  t  covers  1  to  n  measurements.  Equation  (3.13)  can  be 
minimized  analytically  by  dif ferentiatinq  with  respect  to  6 
and  settinq  the  result  equal  to  zero,  which  on  solvinq  for  0 
qives  the  linear  least   square  estimate , 


e  =  [i/n  LtNrt;Nrrt;;-i  l/n  ztN(t)y(t)  (3.14) 


where  9  is  the  estimated  parameter  vector,  equation  (3.11). 
The  recursive  least-squares  alqorithm  [Ref.  7:p.  307] 
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summarizes  in  five  equations  the  way  of  determining  the 
parameter  vector,  6, 

G(t+1)  =  Q(t)+L(t)  [y(t)-QT(t)N(t-l)  ]  (3.15) 

L(t)  =   P(t-l)N(t-l) [l+NT(t-l)P(t-l)N(t-l) ]~* 

P(t)  =   P(t-l)-[A(P,N,t)/B(P,N,t)] 

A(P,N,t)  =  P(t-l)NT(t-l)N(t-l)P(t-l) 

B(P,N,t)  =    l  +  [NT(t-l)P(t-l)N(t-l)  ] 

The  first  equation  of  (3.15)  is  a  predictor-corrector 
equation,  while  the  others  solve  for  the  estimation  gain, 
L(t)  . 

A  special  form  of  a  predictor-corrector  equation  that  is 
used  in  many  least-squares  parameter  estimation  applications 
is  expressed  as  follows:  [Ref.  6:p.  49] 

0(t+l)    =  6(t)+M(t)N(t-l)e(t)  (3.16) 

where   B(t)         denotes  the  parameter  estimate  at  time  t 

M(t)         denotes  an  algorithm  gain  (possibly  a  matrix) 
N(t-l)    denotes  the  regression  vector 
eft)        denotes  the  model  prediction  error 
The  gain  term,  M(t),    may  vary  from  a  scalar  constant  to  a 
covariance  matrix,  as  seen  in  equation  (3.15)  with  L(t)  . 
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From  the  back-propagation  learning  rule  discussed  in  the 
previous  chapter,  equation  (2.10)  is  very  similar  to  the 
linear  least  squares  parameter  estimator,  equation  (3.16), 

Awj±[s]   =  lcoef*e^s^*xJs~^  (2.10) 

The  learning  coefficient,  lcoef,  is  equivalent  to  the 
algorithm  gain,  M(t);  the  error  signal,  e-,  is  equivalent  to 
the  model  prediction  error,  e(t);  and  the  activation  value, 
x±,  is  equivalent  to  the  regression  vector,  N(t-l) .  Thus,  a 
neural  network  using  the  back-propagation  algorithm  is  in  a 
sense  a  linear  least  squares  estimator  [Ref.  7:p.  22].  The 
algorithms  and  theorems  applicable  to  the  linear  least  squares 
estimation  should,  for  the  most  part,  be  applicable  to  the 
back-propagation  neural  network. 

In  summary,  adaptive  control  is  a  combination  of  a  control 
method  and  a  model  estimation.  For  the  control  method,  the 
Model  Reference  Adaptive  Control  (MRAC)  was  chosen  over  the 
Self-Tuning  Regulator  (STR) .  As  to  the  controller  itself,  the 
weighted  one  step  ahead  prediction  controller  was  defined  as 
the  weighted  sum  of  the  state  variables  and  the  reference 
input.  These  weights  or  feedback  gains  are  extracted  from  the 
adjustment  mechanism  of  MRAC  in  Fig.  8  and  are  determined  by 
minimizing  the  error  between  the  network  predicted  output  and 
the  model  output. 
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For  the  estimation  model,  which  is  the  linear  least 
squares  estimate,  the  predicted  output  was  also  defined  as 
some  weighted  sum  of  the  terms  in  the  regression  vector.  This 
time,  the  weights  are  determined  using  the  predictor-corrector 
equation  to  minimize  the  error  between  the  measured  and 
predicted  output. 

By  combining  the  control  and  estimation  models  above,  it 
appears  that  the  back  propagation  learning  rule  could  produce 
models  for  adaptive  control  problems. 
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IV.   X-2  9  MODERN  AIRCRAFT 

The  purpose  of  this  chapter  is  to  present  a  description  of 
the  modern  aircraft  chosen  and  to  describe  the  H2  and  H^ 
controllers  that  were  previously  designed  to  solve  the 
instability  of  that  aircraft.  The  model  used  is  the  subsonic 
longitudinal  dynamics  of  the  X-29  fighter  aircraft.  The  X-29 
is  a  single  seat  forward  swept  wing  (FSW)  demonstrator 
aircraft  built  by  the  Grumman  Corp.  The  FSW  design  offers  a 
new  generation  of  tactical  aircraft  that  is  smaller,  lighter 
in  weight,  less  costly,  and  highly  efficient. 

A.   FIGHTER  DESCRIPTION 

The  aerodynamic  advantages  of  a  forward  swept  wing  have 
been  known  since  the  1940' s.  These  advantages  are:  improved 
maneuverability  with  spin-proof  characteristics,  better  low- 
speed  handling,  and  reduced  stalling  speed.  Another  important 
advantage  is  the  low  drag  across  the  entire  operational 
envelope,  particularly  around  the  sonic  speed,  which  permits 
the  use  of  a  less  powerful  engine  [Ref.  8].  The  FSW  design  is 
expected  to  reduce  the  transonic  drag  about  20%,  and  to 
handle  low  speeds  and  high  angles  of  attack  much  better  than 
any  aft-swept  wing  [Ref.  8:pp.  47].  However,  no  suitable 
structure  could  be  found  in  the  1940' s  to  take  full  advantage 
of  these  benefits.  Only  years  later,  did  the  use  of  advanced 
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composite  materials  offer  a  solution.  The  graphite  composite 
material,  strong  and  light  in  weight,  was  utilized  on  the  FSW 
to  eliminate  the  adverse  static  aeroelastic  coupling  between 
wing  bending  and  torsion.  The  X-29,  shown  in  Figure  9, 
features  close-coupled  canard  surfaces  in  front  of  the 
forward-swept  wings  for  primary  pitch  control.  [Ref.  9] 


Figure  9  Grumman  X-29  FSW  Demonstrator  Aircraft 

The  small  strake  flaps  at  the  rear  of  the  aircraft  provide 
additional  pitch  at  low  speed. 

To  optimize  the  wing  for  various  flight  conditions,  the 
wing's  two  segment  trailing  edges  (flaperons)  behave  as  a 
variable  camber  device  for  pitch  control.  This  variable  camber 
control  will  permit  the  airplane  to  be  optimized  for  low 
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speed,   maneuvering,   cruising,   and   high-speed   flight 
conditions. 

The  X-29  longitudinal  dynamics  model  considered  in  this 
thesis  is  the  analog  reversion  mode  with  the  aircraft  trimmed 
at  0.5  mach,  30,000  feet.  The  original  83rd  order  model  was 
reduced  to  a  14  state  model.  The  reduced  model  includes  a 
short  period  approximation  of  the  aircraft  longitudinal 
dynamics,  the  vertical  velocity,  w,  and  pitch  rate,  q,  and  the 
fourth  order  actuator  dynamics  for  the  three  longitudinal 
control  surfaces,  i.e.,  the  canards,  flaperons  and  strakes. 

Figure  10  shows  the  open  loop  actuator/aircraft  dynamics 
model  of  the  X-29  [Ref.  2].  The  two  separated  commands,  r1  and 
r2,  are  the  input  to  the  three  control  surface  actuators  with 
r2  controlling  the  canards  and  r2  controlling  the  flaps  and 
strakes.  The  outputs  of  the  system  are  the  two  states,  w  and 
q.  The  w-state  becomes  the  angle  of  attack  a  when  divided  by 
the  initial  forward  velocity  UQ.  Therefore,  the  uncompensated 
model  has  two  inputs,  two  outputs,  and  14  states.  The  control 
inputs  to  the  aircraft  dynamics  are  the  canards  6C,  the 
flaperons  Sf,  the  strakes  6S  and  their  respective  first  and 
second  derivatives. 

The  uncompensated  state  variables  are  listed  in  Table  I, 
and  the  open  loop  poles  are  listed  in  Table  II.  Notice  the 
positive  pole,  1.9550,  on  the  real  axis,  meaning  that  the  X-29 
has  an  unstable  short  period  mode. [Ref.  2] 
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Figure  10  Uncompensated  X-29  Open-Loop  Plant 
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TABLE  I  :  UNCOMPENSATED  X-29  MODEL  STATES 

State        Description  Units 

a       angle-of-attack  rad 

q       pitch  rate  rad/sec 

<5c      canard  control  input  rad 

Sf             flap  control  input  rad 

Ss              strake  control  input  rad 

£c     canard  control  rate  rad/sec 

<5f      flap  control  rate  rad/sec 

£       strake  control  rate  rad/sec 

S  ' 

ic              canard  control  accel.  rad/sec2 

#f      flap  control  accel.  rad/sec 

tfs      strake  control  accel.  rad/sec 

#c      canard  control  jerk  le+04  rad/sec3 

tff      flap  control  jerk  le+04  rad/sec 

#s      strake  control  jerk  le+04  rad/sec 

TABLE  II  :  UNCOMPENSATED  X-29  OPEN-LOOP  POLES 

-2.2746e+02  ±  2.3201e+02i 
-1.4491e+02 
-1.4455e+02 
1.9550e+00 
-1.0031e+02 
-2.7155e+00 

-5.2506e+01  ±  4.8410e+01i 
-5.2518e+01  ±  4.8255e+01i 
-5.0067e+01 
-2.0172e+01 
-2.0115e+01 
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B.   H2  AND  H^  CONTROLLERS 

The  uncompensated  X-29  model  possesses  poor  disturbance 
attenuation,  high  sensitivity  to  plant  variations  and  modeling 
errors,  and  a  small  control  bandwidth. 

Three  weighing  functions  were  utilized  in  Ref.  2  to 
improve  these  performance  characterizations  by  suppressing  the 
sensitivity  function  singular  values  as  much  as  possible, 
i.e.,  to  make  the  loop  gains  as  large  as  possible  over  a  wider 
bandwidth.  The  resultant  X-29  augmented  plant  is  a  16th  order 
system,  in  which  the  weighing  functions  added  two  states. 

The  two  Riccati  solution  methods  mentioned  in  Ref.  2 
indicate  that  H2  and  Hro  controllers  must  be  the  same  size  as 
the  augmented  plant.  Therefore,  the  X-29  controller  has  to  be 
of  16th  order.  As  a  result,  the  H^  compensated  X-29  has  a 
larger  disturbance  attenuation,  lower  sensitivity  to 
variations  and  modelling  errors,  and  a  wider  control 
bandwidth.  [Ref.  2] 

Two  Hro  and  H2  controllers  have  been  designed  to  represent 
the  optimal-performance  and  the  limited-  performance  models. 

The  closed-loop  architecture  for  the  H^  compensated  X-29 
is  shown  in  Fig.  11.  The  first  block  is  the  16th  order 
controller  and  the  second  block  the  14th  order  plant  matrix. 
[Ref.  2:p.  62] 
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Closed-Loop  Architecture 
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Figure  11  Closed-Loop  Model  of  the  H^  Compensated  X-29 

Unlike  the  open  loop  actuator/aircraft  dynamics  model  of 
Fig.  10,  the  command  vector  r,  composed  of  elements  r^  and  r2, 
represents  the  reference  commands  for  the  controlled  outputs, 
a  and  g.  The  H^  controllers  have  been  placed  in  series  with 
the  fighter  plant  to  be  fed  backward  with  a  negative  gain  of 
one.  Therefore,  the  closed-loop  system  has  two  inputs,  two 
outputs  and  thirty  states. 

The  longitudinal  equations  of  motion  may  be  expressed  in 
the  following  state  variable  form: 


x(t)    =  Ax(t)    +  Bu(t) 
y(t)    =  Cx(t)    +  Du(t) 


(5.1) 


where  x(t) 


contains  the  state  variables  of  the  Hr 


controller  and  of  the  X-29  plant, 
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u(t)  contains  the  input  variables  rl(t)    and 

r2  (t)  ,  and 
y_(t)  contains  the  output  variables  a(t)    and 

q(t)  . 

1.   Optimal-Performance  Model  (Compensated) 

The  Matlab  program  used  to  obtain  the  closed-loop 
state  space  representation  of  the  Hm  optimal-performance  model 
is  described  in  Ref.  2  pages  115  to  121. 

The  poles  of  the  closed-loop  model  are  listed  in 
Table  III.  The  unstable  short  period  pole,  1.9550,  of  the 
open-loop  system  in  Table  II  is  mirrored  into  the  left  half 
plane  in  Table  III. 

Safonov  [Ref.  11]  indicates  that  this  mirror  imaging 
does  not  cause  any  limitation  to  the  system's  performance  if 
this  pole  is  not  the  dominant  one. 

The  compensated  X-29  model  provides  precision  flight 
path  control  modes  due  to  the  multiple,  independently 
controlled  surface  configuration.  Figure  12  shows  a  graphic 
representation  of  these  precision  control  modes, 

where    a    denotes  angle-of-attack, 
6       denotes  pitch  attitude, 
Y       denotes  flight  path  angle, 
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TABLE  III  :  X-29  OPTIMAL  PERFORMANCE  CLOSED-LOOP  POLES 

-4. 1327e+02 

-2.2745e+02  ±  2.3201e+02i 

-1.3068e+02  ±  4 . 6111e+01i 

-5.3305e+01  ±  8.9700e+01i 

-1.4491e+02 

-1.4452e+02 

-1.3014e+02 

-1.3877e+01  ±  5.9243e+01i 

-9.9794e+01 

-5.2545e+01  ±  4.8359e+01i 

-5.2503e+01  ±  4.8301e+01i 

-7.4132e+01 

-1.9550e+00 

-2.7155e+00 

-2.0379e+01  ±  2.1564e+01i 

-2.0578e+01  ±  1.8907e+01i 

-4.9199e+01  ±  6.5316e+00i 

-4 .2465e+01 

-2.0184e+01 

-2 . 0110e+01 


Xp   and  s   denote  the  aircraft  principal  and 
stability  axes. 

The  three  precision  longitudinal  modes  observed  are  [Ref.12]: 

1.  Vertical  Translation:  The  aircraft's  vertical  velocity  is 
controlled  at  a  constant  6   by  varying  a  ,i.e.,  the 
aircraft's  flight  path  angle,  y ,    or  velocity  vector,  is 
controlled  while  Xs   remains  fixed. 

2.  Direct  Lift  Control:  The  aircraft's  flight  path  angle,  y, 
is  controlled  at  a  constant  a  by  varying  0,    i.e.,  the 
aircraft's  flight  path  angle,  y,    or  velocity  vector, 
remains  along  the  aircraft's  axis  Xp   as  Xs   rotates. 

3.  Pitch  Pointing:  The  aircraft  pitch  attitude,  6,    is 
controlled  at  a  constant  flight  path  angle,  y,    i.e.,  the 
aircraft's  flight  path  angle,  y,    or  velocity  vector 
remains  fixed  while  Xs   rotates  (#=a) . 
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Figure   12    Precision  Control  Modes 
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a.  Time  Domain 

The  longitudinal  motion  of  the  X-29  is  described 
in  time  and  frequency  domains.  For  the  time  domain,  a  pulse 
input  of  one  degree  was  applied  for  one  second  to  each  of  the 
two  reference  commands.  The  a(t)  and  q(t)  time  responses  of 
the  compensated  X-29  for  input  1,  ri ,  and  for  input  2,  r2,  are 
shown  in  Fig.  13  and  14. 

The  vertical  translation  mode  is  represented  by 
Fig.  13  in  which  input  1  separates  q  and  6  from  a.  It  follows, 
that  there  are  negligible  changes  in  q  (order  of  magnitude  10" 
-1)  compared  to  a,  which  has  a  fast  response  of  0.180  sec. 

The  direct  lift  control  mode  is  represented  by 
Fig.  14,  in  which  this  time  input  2  separates  a  from  g.  The  X- 
29  responds  to  input  2  with  a  negligible  a  (order  of  magnitude 
10"1)  and  with  a  positive  g  rise  time  of  0.180  sec. 

b.  Frequency  Domain 

The  continuous  and  discrete  Bode  frequency 
responses  of  a(t)  and  q(t)  for  input  1,  rl ,  and  for  input  2, 
r2 ,  are  shown  in  Fig.  15  through  18. 

The  discrete  frequency  responses  are  dominated  by 
short  period  modes.  For  convenience,  the  high  frequency 
dynamics  above  the  nyquist  frequency  have  been  removed  for  the 
subsequent  Bode  plots. 
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Figure  13  Q  and  a   Time  Responses  to  Input  1  (Optimal  case) 
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Figure  14  Q  and  a  Time  Responses  to  Input  2  (Optimal  case) 
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Figure  15  Continuous  and  Discrete  a  Frequency  Responses 
to  Input  1  (Optimal  case) 
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Figure  16  Continuous  and  Discrete  q  Frequency  Responses 
to  Input  1  (Optimal  case) 
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Figure  17  Continuous  and  Discrete  a   Frequency  Responses 
to  Input  2  (Optimal  case) 
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Figure  18  Continuous  and  Discrete  q  Frequency  Responses 
to  Input  2  (Optimal  case) 
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2.  Limited-Performance  Model 

The  limited-performance  X-29  can  be  characterized  by  a 
smaller  control  and  closed  loop  bandwidth,  a  larger 
sensitivity  to  plant  variations  and  modeling  errors,  and  a 
smaller  disturbance  attenuation  [Ref.  2:p.  87]. 

The  Matlab  program  used  to  obtain  the  closed  loop  state 
space  representation  of  the  H^  limited-performance  model  is 
described  in  Ref.  2  pages  115  to  121.  The  closed  loop  poles 
are  listed  in  Table  IV.  Notice  that  the  same  unstable  short 
period  pole,  1.9550,  of  the  open  loop  system  is  mirrored  into 
the  left  half  plane. 

TABLE  IV  :  X-29  LIMITED  PERFORMANCE  CLOSED-LOOP  POLES 


-2.2747e+02  ±  2.3201e+02l 

-1.3612e+02 

-1.4415e+02 

-1.4494e+02 

-1.4476e+02 

-1.0023e+02 

-5.1688e+01  ±  7.7445e+01i 

-7.2313e+01 

-3.7606e+01  ±  5.2777e+01i 

-5.1716e+01  ±  5.0560e+01i 

-5.3298e+01  ±  4.7220e+01i 

-5.2512e+01  ±  4.8306e+01i 

-5.0505e+01 

-3.6342e+01 

-1.1889e+01  ±  1.2160e+01i 

-l\9539e+00 

-2.7204e+00 

-3.7372e+00 

-9.6752e+00 

-2.0387e+01  ±  1.1180e+00i 

-2.1180e+01 
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a.  Time  Domain 

As  in  the  optimal  performance  case,  a  step  input  of 
one  degree  for  one  second  was  applied  to  each  of  the  two 
reference  commands. 

The  a(t)  and  q(t)  time  responses  of  the  limited- 
performance  X-29  for  input  1,  rlt  and  for  input  2,  r2,  are  in 
Fig.  19  and  20.  The  separation  of  a  and  q  responses  in  both 
inputs  are  not  as  pronounced  as  in  the  compensated  X-29  case. 
The  step  inputs  with  rise  times  of  0.5  sec  and  0.8  sec  to 
input  2  indicate  that  the  limited-performance  model  was  slower 
to  react  , i.e.,  it  is  the  result  of  a  smaller  closed  loop 
bandwidth  [Ref.  2:p.  93]. 

Therefore,  the  precision  flight  path  modes  in  the 
case  of  the  limited-performance  X-29  are  not  as  fully 
accomplished  as  the  optimal-performance  case. 

b.  Frequency  Domain 

The  continuous  and  Bode  frequency  responses  of  a(t) 
and  q(t)  for  input  1  and  2  are  shown  in  Fig.  21  through  24.  As 
in  the  optimal  performance  model,  the  high  frequency  range  was 
limited  to  50  hertz. 
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Figure  19  Q  and  a  Time  Responses  to  Input  1  (Limited  case) 
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Figure  20  Q  and  a  Time  Responses  to  Input  2  (Limited  case) 
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Figure  21  Continuous  and  Discrete  a  Frequency  Responses 
to  Input  1  (Limited  case) 
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to  Input  1  (Limited  case) 
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Figure  2  3  Continuous  and  Discrete  a  Frequency  Responses 
to  Input  2  (Limited  case) 
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Figure  24  Continuous  and  Discrete  q  Frequency  Responses 
to  Input  2  (Limited  case) 
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V.   EXPERIMENTAL  SET-UP 

In  this  chapter,  a  description  of  the  hardware  and 
software  used  for  the  experimental  set-up  of  the  neural 
network  adaptive  control  will  be  given.  Model  design 
considerations  will  follow  which  include  design  objectives, 
model  structure  selections,  and  choices  of  configurations. 
These  configurations  will  be  demonstrated  with  eight  cases 
which  are  the  framework  of  the  experiments  in  the  use  of 
neural  networks  in  adaptive  control. 

A.   HARDWARE  AND  SOFTWARE  REQUIRED 
1.   Hardware 

All  the  research  done  in  the  area  of  data  processing 
was  conducted  on  the  SPARC®  Station  2.  To  emulate  a  parallel 
distributed  processor  which  requires  a  very  large  memory 
capacity  and  high  speed,  the  choice  of  this  station  becomes 
apparent.  The  SPARC®  Station  2  uses  a  32-bit  architecture  with 
a  40  mHz  central  processing  unit,  Sun  4/75  CPU,  and  a  memory 
card  with  48  mBytes  of  RAM.  An  internal  hard  disk  drive  of  207 
mBytes  and  an  external  one  of  996  mBytes  were  added  to  the 
system. 

The  workstation  provides  a  multitasking  windowed 
graphical  environment,  which  greatly  enhances  the  system's 
flexibility  in  addition  to  the  powerful  UNIX  operation  system, 
Sun  OS  4.1.1. 
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A  16-inch  high  resolution  color  monitor,  a  0.25-inch 
cartridge  tape  drive,  and  a  3.5-inch  high  density  diskette 
drive  are  also  part  of  the  system. 

Overall,  the  station's  power  and  flexibility  prove  to 
be  as  important  as  its  memory  size  and  speed  [Ref.  12]. 
2 .   Software 

The  Neuralworks  Professional  II/PLUS  package  by 
Neuralware,  Inc  was  the  neural  networks  software  used. 
Neuralworks  requires  a  minimum  of  400  kBytes  of  base  memory  to 
operate,  and  offers  over  a  dozen  different  types  of  networks, 
from  the  historical  perception  and  the  brain-state-in-a-box, 
to  the  back-propagation  and  the  Boltzmann  machines. 

Neuralworks  has  a  user's  guide,  some  tutorials,  a 
quick  reference  index,  a  menu  listing,  and  many  features  of 
file  inputs  and  outputs.  It  supports  a  general  file  format  for 
inputting  or  outputting  data  to  or  from  the  network  from 
standard  spreadsheet  file  formats  such  as  Lotus  1-2-3  and 
Excel,  from  the  keyboard  interface  if  formatted  in  ASCII 
files,  or  from  user  defined  modules  written  in  the  C 
programming  language.  [Ref.  4:pp.  UG215-UG250] 

Neuralprobe  instruments  are  available  which  provide 
the  ability  to  perform  internal  network  diagnostics  by 
allowing  specify  information  to  be  extracted  from  a  selected 
probe,  and  by  presenting  that  information  in  a  graphical  form 
for  weights,  error  values,  or  activation  levels. 
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As  mentioned  earlier,  the  capability  of  accessing  the 
data  internal  to  Neuralworks  or  presenting  information  to  the 
network,  is  made  possible  through  the  use  of  a  user  defined 
module,  USERIO.  This  method  of  access  incorporates  a  user 
written  procedure  (SimoMonika.c)  to  the  network,  as  shown  in 
Appendix  C. 

The  communication  between  Neuralworks  and  USERIO  is 
through  a  series  of  data  pointers  which  are  described  in  the 
introductory  pages  of  Appendix  A. 

Neuralworks  uses  user-defined  control  strategies  to 
supervise  the  input-output  sequencing,  the  learning,  and  how 
and  when  the  information  is  passed  through  the  layers  of  the 
network.  Neuralworks  provides  also  default  control  strategies 
for  standard  networks.  The  strategies  are  written  in  assembly 
like  language  and  are  automatically  loaded  into  memory  when 
the  networks  are  loaded.  The  two  control  strategies  used  in 
this  research  are  shown  in  Appendix  D.  Both  strategies  will 
be  described  in  more  detail  in  the  following  section. 

The  Matlab  program  with  its  signal  processing  and 
robust-control  tool  boxes  was  used  intensively  during  the 
research.  Written  in  C,  Matlab  provides  a  high-performance 
interactive  software  package  for  scientific  and  engineering 
computation  [Ref.  13].  Matlab  was  employed  mainly  to  perform 
time  and  Bode  frequency  response  analysis  by  comparing  the 
system  and  the  actual  neural  network  responses. 
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In  summary,  the  SPARC  Station  2,  Neuralworks 
Professional  II /PLUS,  and  the  Pro-Matlab  programs  provided  the 
necessary  tools  to  successfully  investigate  the  neural  network 
adaptive  control  algorithm  applied  to  the  longitudinal 
dynamics  of  the  X-29. 

B.   MODEL  DESIGN  CONSIDERATION 
1.   Design  Objectives 

In  any  implementation  of  a  neural  network  adaptive 
controller,  the  design  objectives  of  the  system,  the 
controller  and  the  estimator,  must  be  made  clear. 

The  system  must  be  controllable  and  observable  in 
order  for  the  controller  and  the  estimator  to  be  realizable. 
The  Optimal  and  Limited  performance  cases  fulfill  both 
conditions. 

The  controller  has  to  be  able  to  track  some  sort  of 
model  reference  or  predicted  output.  Stability  is  also  an 
important  aspect  of  a  controller.  The  poles  of  the  transfer 
function  have  to  be  well  within  the  unit  circle  for  stability. 
Zeros  that  are  outside  the  unit  circle  are  non-minimum  phase 
zeros.  When  the  transfer  function  is  inverted,  these  non- 
minimum  phase  zeros  become  unstable  poles.  The  unstable 
inverse  transfer  function  requires  complex  control  devices  for 
exact  tracking  [Ref.  l:pp.  32-49].  The  neural  network  adaptive 
controller  handles  the  non-exact  tracking  by  determining  the 
control  gains  in  some  least  square  sense. 
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The  back-propagation  learning  rule  performs  this  task  with  the 
connections'  weights. 

The  estimator  has  to  model  the  input-output 
relationships  of  the  system.  The  selection  of  proper  inputs  is 
a  complex  issue  involving  the  input  spectrum,  the  sampling 
time,  and  the  data  record  length. 

a.  Input  Spectrum 

All  modes  of  the  system  must  be  excited,  which  is 
known  as  the  concept  of  persistent  excitation  [Ref.  7:p.  72]. 
This  concept  can  be  best  achieved  by  a  proper  selection  of  the 
input  spectrum.  The  input  spectrum  must  be  selected  in  such  a 
way  that  the  output  signal  strength  exceeds  any  expected 
noise.  A  high  signal  to  noise  ratio  must  be  maintained  to 
conserve  most  of  the  information  content  of  the  input  signal. 

b.  Aliasing  and  Sampling  time 

Since  sampling  the  data  leads  to  information 
losses,  it  is  important  to  select  the  proper  sampling  time. 
The  information  loss  is  best  described  in  the  frequency 
domain,  where 

ws  =  2/T  denotes  the  sampling  frequency  where 

T   is  the  sampling  interval,  and 

wN   =  ws/2        denotes  the  Nyquist  frequency. 

The  part  of  the  signal  spectrum  that  corresponds 
to  frequencies  higher  than  wN  will  be  interpreted  as  a 
contribution  from  lower  frequencies.  This  superposition  is 
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known  as  "aliasing" .  Thus,  the  lost  of  information  concerning 
frequencies  higher  than  the  Nyquist  frequency  is  due  to 
sampling.  The  best  antialiasing  filter  is  to  sample  fast 
enough  to  eliminate  the  high-frequency  noise  contributions. 

Nevertheless,  sampling  too  fast  may  cause  loss  of 
information  in  the  low  frequencies,  while  sampling  too  slow 
may  cause  loss  of  information  in  the  high  frequency  modes. 

Another  problem  of  sampling  too  fast  is  the  energy 
distribution  problem  in  the  higher  frequencies  which  receive 
more  excitation.  This  phenomenon  will  be  demonstrated  in 
Chapter  VII  with  different  plots  of  Bode  frequency  responses. 

Figure  25  shows  the  resulting  poles-zeros  plot  for 
the  selected  sampling  time  of  0.02  seconds.  Notice  that  the 
poles  and  zeros  are  well  distributed  between  z  =  0.0  and  z  = 
1.0,  which  is  adequate  for  this  investigation.  Various  trials 
were  conducted  with  different  sampling  times  but  no 
improvements  to  the  value  of  0.02  seconds  were  found. 
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Figure  25  Poles  and  Zeros  of  the  X-29  Closed-Loop  Plant 

c.   Data  Record  Length 

The  simulation  used  in  the  USERIO  program  could 
generate  data  indefinitely.  Modelling  errors  in  the  simulation 
like  aliasing,  the  presence  of  non-minimum  phase  zeros  and 
unstable  poles  propagate  at  a  rate  proportional  to  the  power 
of  the  absolute  value  of  the  system  zeros  [Ref.  5:p.  43].  To 
prevent  the  modelling  errors  from  growing  unboundedly,  the 
simulation  has  to  be  reset  every  so  many  cycles.  Resetting  the 
simulation  adds  noise  to  the  freguency  spectrum,  as  will  be 
demonstrated  in  the  next  chapter. 

For  linear,  stable  systems,  the  data  will  be 
generated  indefinitely  since  the  errors  will  not  grow 
unbounded.  For  linear,  unstable  systems,  the  data  record 


52 


length  will  be  determined  by  limiting  the  network  outputs  to 
specific  values.  Finally,  for  non-linear  systems  using  an 
activation  function  like  the  hyperbolic  tangent  function,  the 
network  output  values  will  be  limited  to  +  1. 
2.   Model  Structure  Selection 

The  model  structure  is  based  on  the  neural  network 
adaptive  controller  in  which  the  estimation  and  control 
algorithms  are  represented.  Before  selecting  the  model,  the 
number  of  input  and  output  elements,  the  status  (linearity  or 
non-linearity)  ,  and  the  order  of  the  system  have  to  be  known. 
This  will  determine  the  size  of  the  regression  vector  which 
defines  the  number  of  elements  in  each  layer.  Whenever 
simulating  a  nonlinear  model,  hidden  layers  are  utilized  with 
nonlinear  transfer  functions. 

The  closed-loop  system  representing  either  the  optimal 
or  the  limited-performance,  is  a  30th  order  linear  system  with 
two  inputs  and  two  outputs.  Hence,  the  selected  model 
structure  could  be  a  MIMO  (multiple  inputs  -  multiple  outputs) 
or  a  SIMO  (single  input  -  multiple  outputs)  if  only  one  input 
is  activated  at  one  time  when  testing  the  network.  The  chosen 
network  structure  does  not  have  any  hidden  layers  since  the 
system  is  linear.  The  network  should  possess  a  regression 
vector  of  90  elements  if  represented  by  a  SIMO  model 
structure,  or  120  elements  if  represented  by  a  MIMO  model 
structure  (30  for  each  input  and  30  for  each  output) . 
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Two   basic   neural   network  model   structures   were 
developed  for  this  research. 

a.   SIMO  Neural  Network  Model  Structure 

Both,  optimal  and  limited,  performances  could  be 
represented  with  SIMO  model  structures.  Figure  26  shows  the 
SIMO  neural  network  structure  used  for  the  30  states  closed 
loop  X-29  plant.  The  first  layer,  the  feedback   layer, 


SIMO  Model  Structure 


del(t-2) 


consists  of  89  elements.  The  first  29  elements  are  the  past 
input  values  del (t-2) ,  del (t-3) ,  .  . .del (t-30)  ,  where  the  delay 
is  indicated  in  parentheses.  The  remaining  60  elements 
represent  the  delayed  past  output  measurements,  30  for  a(t) 
and  30  for  q(t) . 
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The  command  layer,  the  second  layer,  is  a 
replicate  of  the  first  layer  with  the  exception  of  the 
reference  input,  r(t-l) ,  which  is  needed  for  the  control  law. 

The  control  layer,  the  third  layer,  consists  of  a 
single  element,  del (t-1) ,  the  control  input.  The  connections 
between  the  control  input  and  the  command  layer  elements  are 
weighted  with  a  fixed  value  of  zero,  since  the  command  layer 
was  intentionally  included  in  the  network  only  to  represent 
the  regression  vector,  i.e.,  no  learning  is  taking  place.  For 
control  law  purposes,  only  the  connection  between  the 
reference  input,  r (t-1) ,  and  the  control  input,  del (t-1),  is 
weighted  with  a  fixed  value  of  one.  Therefore,  r(t-l)  equals 
del (t-1)  . 

The  last  layer  is  the  output  layer.  The  output 
layer  is  fully  connected  with  variable  weights  to  the  control 
and  the  feedback  layers. 

Notice  that  this  network  has  no  hidden  layers 
between  the  control  and  the  output  layers  since  all  inputs  are 
directly  connected  to  the  output  layer.  Nevertheless,  the 
single  element  in  the  third  layer  becomes  a  hidden  layer  in 
itself,  since  it  relays  the  outputs  of  layer  two  to  layer 
four. 

The  estimation  process  begins  when  the  activation 
value  of  each  output  element  is  compared  directly  to  its  model 
predicted  output,  and  the  current  error  is  back-propagated 
through  the  control  and  feedback  layers  by  adjusting  their  weights. 
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b.   MIMO  Neural  Network  Model  Structure 

Figure  27  shows  a  MIMO  model  structure  used  for 
the  30  state  closed  loop  plant  of  the  X-29.  This  time,  two 
reference  and  control  inputs  were  present,  r1(t-l) ,  r2(t-l), 
del1(t-l)  and  del2(t-l)  .  As  with  the  SIMO  structure,  r1(t-l) 
and  r2(t-l)    equal  del1(t-l)    and  del2(t-l)  . 


MIMO  Model  Structure 
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Figure  27  MIMO  Neural  Network  Model  Structure 

As  expected,  the  size  of  the  regression  vector  has 
increased  from  90  elements  to  120,  since  the  second  input  past 
measurements  are  added  to  the  vector. 
3.   Choices  of  Configurations 

In  this  thesis,  three  configurations  are  proposed  for 
training  neural  networks  to  provide  the  appropriate  inputs  to 
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the  X-29  plant  in  which  desired  responses  are  obtained.  These 
three  configurations  are:  the  simulation  of  the  closed-loop 
plant,   the  identification  of  the  inverse  plant,  and  the 
simulations  of  the  existing  controllers  and  the  plant. 
a.   Simulation  of  the  Closed-Loop  Plant 

In  this  first  configuration,  the  neural  network 
will  emulate  the  closed-loop  architecture  of  Fig.  28.  The 
inputs,  r_j  and  r2,  to  the  30  states  transfer  function  that 
comprises  the  controller  and  the  plant  in  series  and  a 
negative  feedback  loop  of  gain  one,  will  be  the  inputs  to  the 
neural  network.  The  outputs  of  the  3  0  states  transfer 
function,  a  and  q,  which  represent  the  true  system  outputs, 
will  be  the  desired  outputs  of  the  neural  network. 


Closed-Loop  Architecture 
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Figure  28  Closed-Loop  Architecture 
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Each  performance,  the  optimal  and  the  limited, 
will  be  emulated  using  one  MIMO  model  structure  as  shown  in 
Fig.  27. 

In  order  to  facilitate  the  integration  of  the 
configurations  to  the  USERIO  program,  specific  case  numbers 
are  associated  with  each  configuration.  That  way  all  three 
configurations  can  use  the  same  USERIO  program,  SimoMonika.c. 
Each  case  number  is  stated  in  a  header  file.  A  header  file 
defines  all  the  variables  utilized  in  the  USERIO  program:  the 
case  number,  the  sampling  time,  the  input  conditions,  the 
numerator  and  the  denominator  coefficients  of  the  transfer 
functions.  All  the  header  files,  or  transfer. h  files,  used  for 
this  research  are  shown  in  Appendix  C.  The  numerator  and 
denominator  coefficients  were  obtained  using  the  MATLAB  file 
of  Appendix  D. 

As  to  the  control  strategy,  the  first  prototype, 
contstrl .nnc ,  described  in  Appendix  B  is  employed  when  only 
one  structure  or  network  is  needed  to  represent  the 
configuration.  The  second  control  strategy,  contstr2.nnc,  is 
employed  when  two  networks  are  needed  to  represent  the 
configuration.  Therefore,  the  single  MIMO  network  needed  to 
simulate  the  closed-loop  plant  should  be  trained  using  the 
first  control  strategy,  contstrl. nnc. 

Both  control  strategies  use  the  back-propagation 
algorithm  with  the  generalized  delta  learning  rule  which 
reduces  the  error  between  the  actual  and  desired  outputs  of  a 
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processing  element  by  modifying  the   incoming  connection 
weights . 

The  table  in  Appendix  E  shows  the  case  number,  the 
model  structure,  the  control  strategies,  and  the  header  files 
associated  with  each  configuration.  Notice  that  this  first 
configuration  contains  two  cases.  Case  #1  emulates  the  optimal 
performance  model,  and  case  #2  emulates  the  limited 
performance  model.  Also  notice  that  the  model  structure  has 
been  divided  into  two  levels.  Level  1  and  2  represent  the 
first  and  the  second  network  to  be  trained.  Both  levels  are 
usually  connected  in  series  and  could  be  trained  either  one  at 
a  time  or  both  simultaneously  depending  on  the  configuration 
chosen.  In  this  configuration,  only  level  1  applies  since  only 
one  network  is  necessary  to  represent  each  of  the  two  cases. 

When  training  neural  networks,  the  stability  of 
the  system  being  emulated  is  an  important  factor  to  be 
considered.  Since  the  transfer  functions  of  the  optimal  and 
the  limited-performance  models  are  stable  and  linear,  there 
should  be  no  requirements  for  resetting  the  networks.  The 
error  should  not  grow  unbounded  during  the  learning  process, 
b.   The  Identification  of  the  Inverse  Plant 

Figure  29a  demonstrates  the  second  configuration 
where  an  adaptive  architecture  is  presented  to  identify  the 
inverse  of  a  plant  [Ref.  14]. 
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Figure  29  Inverse  Plant  Architecture 

The  single  input,  u,  to  the  plant  will  be  the 
input  to  the  network  emulating  the  plant,  and  the  outputs  to 
the  plant,  a  and  g,  which  represent  the  true  plant  outputs, 
will  be  the  desired  network  plant  outputs.  Then,  the  network 
plant  outputs  become  inputs  to  the  network  emulating  the 
inverse  plant,  and  the  input  to  the  plant,  u,  becomes  the 
desired  network  inverse  plant  output.  Once  the  plant  inverse 
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has  been  found,  it  can  be  used  for  control  purposes  as  shown 
in  Fig.  29b.  The  desired  plant  output,  y'~y,  is  fed  into  the 
inverse  plant,  and  the  resulting  output  is  used  as  input  to 
the  plant.  As  a  result,  the  plant  input  produces  the  desired 
plant  output. 

This  control  method  can  be  applied  to  the  control 
of  linear  and  non-linear  systems  [Ref.  14:p.  34].  The 
configuration  differs  from  the  closed-loop  architecture  of 
Fig.  28  in  that  the  input  to  the  inverse  plant  is  the  desired 
plant  output  instead  of  the  actual  output,  and  that  no 
feedback  to  the  controller  is  required. 

In  this  second  configuration,  three  cases  will  be 
investigated,  as  shown  in  Appendix  E.  The  first  case  examines 
the  large  order  transfer  function  of  the  30  states  closed-loop 
X-29  longitudinal  plant  whose  inverse  is  stable.  The  second 
case  will  examine  a  simpler  aircraft,  the  A-4D,  which  has  a 
much  smaller  order  transfer  function,  but  whose  inverse  is 
unstable.  The  inverse  longitudinal  plant  of  the  A-4D  aircraft 
is  unstable  due  to  the  fact  that  the  plant  has  a  non-minimum 
phase  zero  at  -3.65  whose  inverse  becomes  an  unstable  pole,  as 
shown  in  Fig.  30. 
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Figure  30  Poles  and  Zeros  of  the  A-4D  Plant 

Finally,  the  third  case  examines  the  X-29  plant 
which  is  a  larger  order  system  than  the  A-4D  and  which  has  one 
unstable  pole  at  +1.05  and  three  non-minimum  phase  zeros 
located  at  -4.5,  +2.2  and  +9.5,  as  shown  in  Fig.  31.  As  a 
consequence  of  the  unstable  pole,  the  X-29  plant  is  unstable, 
and  as  a  consequence  of  the  three  non-minimum  phase  zeros,  the 
inverse  plant  is  also  unstable. 
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Figure  31  Poles  and  Zeros  of  the  X-29  Plant 

In  all  three  cases,  the  model  structure  is 
composed  of  two  levels:  level  1  emulates  the  closed-loop  plant 
for  case  #3  or  the  plant  for  cases  #4  &  5,  and  level  2 
emulates  their  inverse.  The  two  levels  are  connected  in  series 
and  can  be  trained  simultaneously. 

Figure  32  shows  the  inverse  plant  neural  network 
structures  developed  for  this  investigation.  As  anticipated 
from  Fig.  29,  this  configuration  requires  one  SIMO  neural 
network  model  structure  to  emulate  the  plant  and  one  MISO 
neural  network  model  structure  to  emulate  the  inverse  plant. 
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Configuration  #  2  :    Identification  of  the  Inverse  Plant 
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Figure  32  Configuration  #2 
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The  input  of  the  plant,  u(t-l) ,  becomes  the  output 
of  the  inverse  plant,  and  the  output  of  the  plant,  ot(t)  and 
q(t)  ,  becomes  the  input  of  the  inverse  plant.  These  two 
operations  are  performed  in  the  USERIO  program,  and  are 
demonstrated  in  the  introductory  pages  of  Appendix  A. 

Since  both  systems,  the  X-29  plant  and  its 
inverse,  are  unstable,  the  neural  networks  will  have  to  be 
reset  many  times  to  prevent  the  error  from  growing  unbounded 
during  learning. 

c.   The  Simulations  of  the  Existing  Controllers 

and  the  Plant 

Figure  33  shows  the  third  configuration 
architecture.  The  inputs  to  the  controller,  d1  and  d2,  which 
are  the  error  between  the  reference  inputs  and  the  plant 
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Figure  33  Open-Loop  Architecture 
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outputs,  will  be  the  inputs  to  the  network  emulating  the 
controller.  The  outputs  of  the  controller,  u^  and  u2,  will  be 
the  desired  network  controller  outputs  and  the  inputs  to  the 
network  emulating  the  plant.  The  true  plant  outputs,  a  and  g, 
become  the  desired  network  plant  outputs. 

In  Fig.  28  the  entire  closed-loop  architecture  is 
emulated,  whereas  in  this  configuration  each  controller  and 
plant  is  simulated  separately  as  an  open-loop  architecture. 
Each  performance,  the  optimal  and  the  limited,  has  its  own 
controller  but   the  same  plant. 

As  shown  in  Appendix  E,  the  configuration  has 
three  cases.  Case  #6  &  #7  emulate  the  optimal  or  the  limited 
performance  controller  plus  the  plant,  and  case  #8  makes  the 
closure  of  the  open-loop  system  of  each  case.  The  closure 
implies  the  connection  in  series  of  the  controller  and  the 
plant,  and  the  insertion  of  a  negative  feedback  loop  of  gain 
one  from  the  plant  outputs  to  the  controller  inputs. 

Both  controllers  are  emulated  at  level  1  and  the 
plant  is  emulated  at  level  2,  using  MIMO  model  structures  as 
shown  in  Fig.  34.  In  all  three  cases  both  levels  can  be 
trained  simultaneously. 
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Configuration  #  3  :    Simulation  of  the  Existing 

Controllers  and  the  Plant 
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Figure  34  Configuration  #3  :  Simulation  of  the 
Existing  Controllers  and  the  Plant 


67 


Referring  to  Fig.  34,  case  #8  is  represented  by 
having  the  controller  outputs,  ul(t)  and  u2  (t) ,  becoming  the 
plant  inputs,  and  the  error  between  the  plant  outputs,  aft) 
and  q(t) ,  and  the  reference  inputs,  rl(t)  and  r2 (t) ,  becoming 
the  controller  inputs,  dl(t-l)  and  62  (t-1) .  These  operations 
are  performed  in  the  USERIO  program  and  are  demonstrated  in 
the  introductory  pages  of  Appendix  E. 

The  utility  of  this  third  configuration,  knowing 

that  effective  controllers  exist,  is  that: 

The  adaptive  network  may  be  able  to  form  an  effective 
control  rule  on  the  basis  of  representation  of  the  system 
state  that  is  easier  to  measure  than  the  representation 
required  by  the  existing  controller.  [Ref.  7:p«  30] 
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VI.   RESULTS  AND  DISCUSSION 

The  experimental  results  of  the  eight  configurations' 
cases  described  in  Chapter  V  will  be  presented  in  this 
chapter.  Time  and  frequency  domain  analyses  of  the  neural 
network  structures  of  each  case  will  be  performed  to  determine 
how  close  they  are  to  the  true  system.  All  configurations 
except  case  #6  will  use  linear  networks.  Nonlinearity  will  be 
introduced  in  case  #6,  when  two  hidden  layers  are  added  with 
a  hyperbolic  tangent  transfer  function  to  the  network 
emulating  the  optimal  performance  controller. 

To  further  investigate  the  nonlinear  network  models,  an 
analysis  using  the  singular  value  decomposition  (SVD)  will  be 
carried  out  on  the  controller  network  of  case  #6.  The  optimal 
number  of  elements  per  hidden  layer  will  be  determined. 

A.   CONFIGURATION  #1:  SIMULATION  OF  THE  X-29  CLOSED- 
LOOP  PLANT 

1.   Case  #1  -  Optimal  Performance  X-29  Closed-Loop  Plant 

The  first  case  emulates  the  optimal  performance  X-29 
closed-loop  plant.  The  neural  network  is  trained  using  a 
single  MIMO  model  structure  fully  connected  with  a  linear 
activation  function.  Fully  connected  means  that  all  the 
elements  in  the  feedback  and  control  layer  are  connected  to 
all  the  elements  in  the  output  layer.  After  20,000  cycles  or 
3  00  seconds,  the  network  has  learned  to  respond  correctly  to 
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two  random  binary  inputs  of  magnitude  1.  The  random  binary 
swept  square  wave  is  an  input  signal  which  excites  all  the 
frequencies  of  interest. 

The  frequency  responses  of  the  linear  neural  network 
and  the  frequency  responses  of  the  optimal-performance  X-29 
model  to  two  random  binary  inputs  are  displayed  with  discrete 
Bode  plots  in  Fig.  35  through  Fig.  38.  The  frequency  responses 
of  a(t)  to  input  1  and  2,  which  are  shown  in  Fig.  35  and  37, 
develop  near  to  exact  model  solutions.  As  expected,  a  small 
amount  of  unmodelled  noise  dynamics  can  be  seen  around  the 
sampling  frequency  of  50  hertz.  In  Fig.  37,  the  network  does 
not  model  exactly  the  low  frequency  region  even  after  20,000 
epochs.  The  frequency  responses  of  q(t)  to  input  1  and  2, 
which  are  shown  in  Fig.  36  and  38,  are  very  similar  to  the 
ones  of  a(t).  The  high  frequency  regions  of  both  inputs  and 
the  low  frequency  region  of  input  2  are  very  well  represented, 
whereas  the  low  frequency  region  of  input  1  shows  a  minor 
deviation  from  the  true  response,  as  shown  in  Fig.  36. 

To  show  how  close  the  network  outputs  are  to  the  true 
X-29  outputs,  the  RMS  prediction  error  plots  for  a  and  q  are 
given  in  Fig.  39  and  40.  Notice  that  the  vertical  scales  are 
on  the  order  10"3.  As  anticipated,  the  network  has  learned 
very  well  with  RMS  errors  on  the  order  of  0.00175  for  a  or 
0.175  percent  of  the  maximum  output  value  of  one,  and  on  the 
order  of  0.003  for  q.  Further  training  did  not  improve  the 
present  results. 
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The  performance  of  the  neural  network  in  the  time 
domain  was  determined  by  applying  a  step  of  one  degree  for  one 
second  to  each  input,  and  by  comparing  the  network's  outputs 
to  the  true  system,  as  shown  in  Fig.  41  through  Fig.  44.  As 
with  the  frequency  domain,  the  network  has  learned  to  model 
the  true  system  in  the  time  domain.  By  comparing  the  magnitude 
of  the  time  responses  of  Fig.  41  with  Fig.  42  ,  it  can  be  seen 
that  the  X-29  model  and  the  network  respond  to  input  1  with  a 
positive  a  while  the  g  response  is  negligible  (  order  of 
magnitude  is  10-1  ).  In  Fig.  41,  the  network  responds  with  the 
same  a  rise  time  of  0.180  seconds,  and  with  the  same  magnitude 
of  about  1.08  degree  as  the  true  model.  In  Fig.  42,  the 
network  q  response  is  as  fast  with  a  rise  time  of 
approximately  .095  seconds.  The  small  oscillations  produced  by 
the  neural  network  g  response  in  Fig.  42  are  negligible  since 
the  magnitude  of  the  signal  is  very  low. 

By  comparing  the  magnitude  of  the  time  responses  of 
Fig.  43  with  Fig.  44,  it  can  be  seen  that  the  responses  of 
input  2  are  the  reversed  responses  of  input  1,  i.e.,  this 
time,  the  q  response  is  positive  while  the  a  response  is 
negligible  with  an  order  of  magnitude  10"1. 
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Figure  35  X-29  Model  and  Network  a  Frequency  Responses 
to  Input  1  (Optimal  case) 
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Figure  36  X-29  Model  and  Network  q  Frequency  responses 
to  Input  1  (Optimal  case) 
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Figure  37  X-29  Model  and  Network  a  Frequency  Responses 
to  Input  2  (Optimal  case) 
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Figure  38  X-29  Model  and  Network  q  Frequency  responses 
to  Input  2  (Optimal  case) 
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Figure  41  X-29  Model  and  Network  a  Time  Responses 
to  Input  1  (Optimal  case) 
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Figure  42  X-29  Model  and  Network  q  Time  Responses 
to  Input  1  (Optimal  case) 
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2.   Case  #2  -  Limited  Performance  X-29  Closed-Loop  Plant 

This  second  case  emulates  the  limited  performance  X-29 
closed-loop  plant.  The  neural  network  is  trained  using  also  a 
single  MIMO  model  structure  fully  connected  with  a  linear 
activation  function.  The  network  has  learned  to  respond 
correctly  after  20,000  cycles  or  300  seconds  using  two  random 
binary  inputs  of  magnitude  1. 

The  frequency  responses  of  the  linear  neural  network 
and  the  frequency  responses  of  the  limited  performance  X-29 
model  to  two  random  binary  inputs  are  displayed  with  discrete 
Bode  plots  in  Fig.  45  through  Fig.  48.  The  frequency  responses 
of  a(t)  and  q(t)  to  input  1  and  2,  which  are  shown  in  Fig.  45 
through  48,  develop  near  to  exact  model  solutions.  As  with  the 
optimal  case  #1,  the  frequency  responses  of  a(t)  to  input  1 
and  2  show  unmodelled  noise  dynamics  around  the  sampling 
frequency  of  50  hertz,  as  shown  in  Fig.  45  and  47.  Further 
training  did  not  improve  the  present  results.  Contrary  to  the 
optimal  case  #1,  the  network  is  better  able  to  model  the  low 
frequencies  of  both  inputs. 

RMS  prediction  error  plots  for  a  and  g  are  given  in 
Fig.  49  and  50.  Notice  that  the  vertical  scales  are  on  the 
order  10~3.  As  expected,  the  network  has  learned  very  well 
with  RMS  errors  on  the  order  of  0.001  for  a  or  0.1  percent  of 
the  maximum  output  value  of  one  and  on  the  order  of  0.002  for 
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The  network  has  also  learned  to  model  correctly  the 
limited  performance  X-29  closed-loop  plant  in  the  time  domain. 
The  X-29  model  and  the  network  time  responses  to  input  1  and 
2  are  given  in  Fig.  51  through  Fig.  54.  As  with  the  optimal 
performance  X-29  of  case  #1,  the  limited  performance  X-29 
model  and  the  network  responded  to  input  1  with  a  positive  a 
and  to  input  2  with  a  semi-positive  g,  as  shown  in  Fig.  51  and 
54.  However,  the  decoupling  of  a  and  g  is  not  as  pronounced  as 
in  the  optimal  performance  case,  i.e.,  this  time,  the  q(t) 
responses  in  Fig.  52  and  the  a(t)  responses  in  Fig.  53  are  not 
negligible. 

The  step  responses  of  input  2  with  an  a  rise  time  of 
0.8  second,  in  Fig.  53,  and  with  a  g  rise  time  of  0.5  second, 
in  Fig.  54,  indicate  that  the  limited  performance  X-29  model 
and  the  network  are  slower  to  react  than  the  optimal 
performance  case  #1.  In  the  optimal  case  #1,  the  rise  time  of 
a  to  input  2  was  0.180  second  and  the  rise  time  of  q  to  input 
2  was  0.095.  The  slower  reaction  times  of  the  limited 
performance  case  is  due  to  the  fact  that  the  control  surface 
deflections  and  the  control  rates  of  the  X-29  airplane  were 
reduced  to  conform  with  the  actuators  limitations  [Ref.  2]. 

In  summary,  the  first  configuration  could  simulate 
case  #1,  the  large  order  and  stable  optimal  performance  X-29 
closed-loop  plant,  and  case  #2,  the  large  order  and  stable 
limited  performance  X-29  closed-loop  plant,  with  high 
accuracy. 
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Figure  45  X-29  Model  and  Network  a   Frequency  Responses 
to  Input  1  (Limited  case) 
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Figure  46  X-29  Model  and  Network  q  Frequency  responses 
to  Input  1  (Limited  case) 
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Figure  47  X-29  Model  and  Network  a   Frequency  Responses 
to  Input  2  (Limited  case) 
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Figure  48  X-29  Model  and  Network  q  Frequency  responses 
to  Input  2  (Limited  case) 
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Figure  49  RMS  Prediction  Errors  for  a 
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Figure  51  X-29  Model  and  Network  a  Time  Responses 
to  Input  1  (Limited  case) 
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Figure  52  X-29  Model  and  Network  q  Time  Responses 
to  Input  1  (Limited  case) 
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Figure  53  X-29  Model  and  Network  a  Time  Responses 
to  Input  2  (Limited  case) 
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Figure  54  X-29  Model  and  Network  q  Time  Responses 
to  Input  2  (Limited  case) 
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B.   CONFIGURATION  #2:  IDENTIFICATION  OF  THE  INVERSE  PLANT 

The  second  configuration  is  divided  into  three  cases.  Each 

case  contains  two  levels  of  model  structure  as  shown  in  the 

inverse  plant  architecture  of  Fig.  29  in  Chapter  V.  The  neural 

network  representation  of  the  inverse  plant  architecture  is 

illustrated  in  Fig.  32.  The  SIMO  neural  network  structure  of 

the  first  level  in  Fig.  32  simulates  the  transfer  function  or 

the  plant,  and  the  MISO  neural  network  structure  of  the  second 

level  in  Fig.  32  simulates  the  inverse  transfer  function  or 

the  inverse  plant.  Before  attempting  to  test  the  inverse  plant 

neural  network  structures  of  Fig.  32  with  unstable  systems 

like  the  A-4D  or  the  X-29  inverse  plant,  the  stable  inverse  30 

states   closed-loop   transfer   function   of   the   optimal 

performance  X-29  model  will  be  examined  first.  Then,  the 

testing  of  the  small  order,  unstable  inverse  plant  of  the  A-4D 

will  follow  and  finally  the  unstable  inverse  plant  of  the  X-29 

will  be  investigated. 

1.   Case  #  3  -  Inverse  Closed-Loop  Plant  of  the  Optimal 
Performance  X-29  Model 

Since  the  transfer  functions  for  a(t)  and  q(t)  do  not 
have  any  non-minimum  phase  zeros,  the  inverse  30  states 
closed-loop  transfer  functions  of  the  optimal-performance  case 
are  stable. 

The  two  networks'  structure  of  Fig.  32  have  learned  to 
model  the  inverse  transfer  function  within  4  50,000  epochs  or 
11,250   seconds.   The  SIMO  network  structure   of  Fig.   32 
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representing  the  30  states  closed-loop  transfer  function  and 
the  MISO  network  structure  of  Fig.  32  representing  the  inverse 
transfer  function  have  been  trained  simultaneously.  As  with 
the  first  configuration,  a  random  binary  swept  square  wave  of 
magnitude  1  was  also  the  input  signal  at  level  1. 

After  the  two  networks  of  Fig.  32  are  fully  trained, 
the  random  binary  step  outputs  of  the  inverse  transfer 
function  at  level  2  (output  2)  should  be  equal  to  the  random 
binary  step  input  of  the  transfer  function  at  level  1  (input 

1)  .  A  time  history,  based  on  the  number  of  epochs,  of  the 
comparison  between  the  input  of  the  30  states  closed-loop 
transfer  function  and  the  output  of  the  inverse  transfer 
function  to  a  random  binary  input  signal  is  shown  in  Fig.  55 
through  Fig.  62.  The  RMS  errors  between  the  two  signals, 
output  2  and  input  1,  are  also  included  in  the  list  of 
figures. 

As  indicated  in  Fig.  55,  after  2000  epochs  or  500 
seconds,  the  output  of  the  inverse  transfer  function  (output 

2)  is  poorly  correlated  with  the  input  of  the  transfer 
function  (input  1).  The  RMS  error  is  approximately  1.00  or  100 
percent  of  the  maximum  output  value  of  one,  as  shown  in  Fig. 
56.  After  150,000  epochs  or  3750  sec,  output  2  shows  some 
similarities  with  input  1,  as  indicated  in  Fig.  57.  The 
network  emulating  the  inverse  transfer  function  at  level  2 
learned  to  limit  its  output  to  values  +1  and  to  follow  the 
random  binary  step  inputs  of  the  transfer  function  at  level  1 
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more  closely.  This  time  the  RMS  error,  shown  in  Fig.  58, 
decreased  from  1.0  to  0.35.  After  250,000  epochs  or  6250  sec, 
output  2  shows  even  better  similarities  with  input  1,  as 
demonstrated  in  Fig.  59.  Only  the  magnitude  of  the  steps  need 
to  be  worked  on.  In  this  third  trial,  the  RMS  error  in  Fig.  60 
is  on  the  order  of  0.175.  Finally  in  Fig.  61,  after  450,000 
epochs  or  11,2  50  sec,  the  output  of  the  inverse  transfer 
function  (output  2)  shows  a  near  to  exact  solution  to  the 
input  of  the  transfer  function  (input  1)  .  The  lowest  RMS  error 
obtained  is  on  the  order  of  .008  or  0.8  percent  of  the  maximum 
output  value  of  one,  as  shown  in  Fig.  62. 

The  discrete  Bode  plots  in  Fig.  63  and  64  give  the  a 
and  q  frequency  responses  to  input  1  of  the  true  optimal 
performance  X-29  closed-loop  transfer  function  and  of  network 
2,  which  emulates  the  inverse  transfer  function.  The  frequency 
responses  of  network  1,  emulating  the  transfer  function,  were 
given  in  the  optimal  performance  case  #1. 

As  explained  in  Appendix  D,  the  Bode  plots  are 
obtained  using  the  spectral  transfer  function.  The  spectral 
transfer  function  is  calculated  using  an  output  vector  and  an 
input  vector.  When  dealing  with  the  neural  network  transfer 
function  of  level  1  in  Fig.  32,  the  input  vector  is  composed 
of  the  random  binary  step  input  signals  at  input  1  and  the 
output  vector  is  composed  of  the  a  and  q  time  responses  at 
output  1.  However,  when  dealing  with  the  neural  network 
inverse  transfer  function  of  level  2  in  Fig.  32,  the  input 
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vector  is  composed  of  the  random  binary  step  responses  at 
output  2  and  the  output  vector  is  composed  of  the  a  and  q 
input  signals  at  input  2. 

The  frequency  responses  are  well  modelled  across  the 
spectrum  with  the  exception  of  a  minor  deviation  in  the  low 
frequency  region  of  the  network  2  g  response  in  Fig.  64. 

In  both  time  and  frequency  domain  the  SIMO  and  MIMO 
neural  network  structures  of  Fig.  32  have  learned  to  model  the 
inverse  transfer  function  of  a  large  order,  stable  system. 
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RB  Input  comparison  after  2000  epochs 
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Figure  55  RB  Input  Comparisons  after  2000  Epochs  (case  #3) 


RMS  Error  after  2000  epochs 


O 

s 


0     0.2    0.4    0.6    0.8     1     1.2    1.4    1.6    1.8     2 

TIME  -  SEC 
Figure  56  RMS  Prediction  Error  after  2000  Epochs  (case  #3) 


88 


RB  Input  comparison  after  150K  epochs 
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Figure  57  RB  Input  Comparisons  after  150K  Epochs  (case  #3) 
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Figure  58  RMS  Prediction  Error  after  150k  Epochs  (case  #3) 


89 


1.5 


■1.5 


-: 


RB  Input  comparison  after  250K  epochs 
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Figure  59  RB  Input  Comparisons  after  250K  Epochs  (case  #3) 
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Figure  60  RMS  Prediction  Error  after  250k  Epochs  (case  #3) 
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RB  Input  comparison  after  450K  epochs 
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Figure  61  RB  Input  Comparisons  after  450K  Epochs  (case  #3) 
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Figure  62  RMS  Prediction  Error  after  450k  Epochs  (case  #3) 
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Figure  63  X-29  Inverse  Plant  Model  and  Network  2  a 

Frequency  Responses  to  Input  1  (Optimal  case) 
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2.   Case  #  4  -  Inverse  Plant  of  the  A-4D  Aircraft 

The  fourth  case  analyses  an  open-loop  transfer 
function,  the  A-4D  fourth  order  plant,  instead  of  a  closed- 
loop  transfer  function,  the  X-29  30th  order  system  of  case  #3. 
As  mentioned  in  the  previous  chapter,  the  A-4D  plant  is  a 
small  order  system  whose  inverse  is  unstable  due  to  the  fact 
that  the  plant  has  a  non-minimum  phase  zero. 

In  this  configuration,  level  1  of  the  inverse  plant 
architecture  of  Fig.  29  represents  the  A-4D  plant  and  level  2 
represents  its  inverse.  In  Fig.  32,  the  same  SIMO  and  MISO 
neural  network  structures  of  the  X-29  case  #3  were  used  for 
this  case  with  the  exception  of  three  modifications.  The  first 
modification  is  that  there  are  four  outputs  to  the  A-4D  plant 
at  level  1  (u,a,g,  and  theta)  instead  of  two  for  the  X-29 
plant  (a  and  q)  ,  thus  there  are  four  inputs  to  level  2 
instead  of  two.  The  second  modification  is  that  the  network  of 
level  2  emulates  the  small  and  unstable  A-4D  inverse  plant 
instead  of  the  large  and  stable  X-29  inverse  plant.  Finally, 
the  third  modification  is  that  the  sampling  time  for  the  A-4D 
aircraft  is  0.1  seconds  instead  of  0.02  seconds  for  the  X-29 
aircraft.  The  sampling  time  being  0.1  seconds  indicates  that 
the  A-4D  longitudinal  modes  are  slower  than  the  X-29  dynamic 
modes. 

The  SIMO  and  the  MISO  networks  of  Fig.  32  have  learned 
to  model  the  A-4D  inverse  plant  after  25,000  cycles  or  450 
seconds.  The  random  binary  step  outputs  of  the  inverse  plant 

93 


network  2  (output  2)  shows  a  very  near  to  exact  solution  to 
the  random  binary  step  inputs  of  the  plant  network  1  (input 
1) ,  as  shown  in  Fig.  65.  The  lowest  RMS  error  obtained  is  on 
the  order  of  0.00015  or  0.015  percent  of  the  maximum  output 
value  of  one,  as  indicated  in  Fig.  66.  Notice  that  the 
vertical  scales  are  on  the  order  10~4. 

As  expected,  the  speed  of  the  simulation  was  much 
faster  for  the  A-4D  model  of  case  #4  than  for  the  X-29  model 
of  case  #3  since  the  order  of  the  system  is  seven  and  a  half 
times  smaller.  The  order  of  the  system  in  addition  to  the 
number  of  inputs  and  outputs  determines  the  number  of  elements 
in  the  regression  vector.  The  number  of  elements  in  the 
regression  vector  determines  the  number  of  connections  in  the 
neural  network  structure,  which  in  turn  determines  the  speed 
of  the  simulation.  The  smaller  the  order  of  the  system,  the 
smaller  the  number  of  connections  required  in  the  neural 
network,  and  therefore  the  faster  the  simulation. 

The  discrete  Bode  plots  of  Fig.  67  through  Fig.  70 
give  the  u,  a,  g,  and  theta  frequency  responses  of  the  A-4D 
plant  model  and  of  network  1,  which  emulates  the  plant.  The 
discrete  Bode  plots  of  Fig.  71  through  Fig.  74  give  the  u,  a, 
q  and  theta  frequency  responses  of  the  A-4D  inverse  plant 
model  and  of  network  2,  which  emulates  the  inverse  plant. 

As  with  the  X-29  model  case  #3,  the  spectral  transfer 
function  of  the  A-4D  inverse  plant  of  level  2  has  been 
calculated  using  the  random  binary  step  responses  of  output  2 
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as  the  input  vector  and  the  u,  a,  q  and  theta  input  signals  of 
input  2  as  the  output  vector.  Both  networks,  network  1 
simulating  the  A-4D  plant  and  network  2  simulating  the  A-4D 
inverse  plant,  as  shown  in  Fig.  67  through  Fig.  74,  have  no 
difficulties  to  model  the  high  frequency  region.  However,  even 
with  further  training,  the  networks  are  unable  to  better  model 
the  low  frequency  region.  The  same  results  were  obtained,  in 
respect  to  the  plant,  by  R.  Scott  [Ref.  1] . 

Knowing  that  the  time  responses  of  a(t)  and  q(t)  are 
predominantly  of  high  frequency  or  short  period  mode,  it  can 
be  seen  looking  from  the  Bode  plots  that  the  emulations  of  the 
A-4D  plant  and  its  inverse  have  been  accomplished  with  high 
accuracy. 
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RB  Input  comparison  after  25000  epochs 
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Figure  65  RB  Input  Comparisons  after  25K  Epochs  (case  #4) 
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Figure  66  RMS  Prediction  Error  after  25K  Epochs  (case  #4) 
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Figure  67  A-4D  Plant  Model  and  Network  1  u  Frequency 
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Figure  68  A-4D  Plant  Model  and  Network  1  a  Frequency 
Responses 
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Figure  69  A-4D  Plant  Model  and  Network  1  q  Frequency 
Responses 
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Figure  70  A-4D  Plant  Model  and  Network  1  theta  Frequency 
Responses 
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Figure  71  A-4D  Inverse  Plant  Model  and  Network  2  u 
Frequency  Responses 
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Figure  72  A-4D  Inverse  Plant  Model  and  Network  2  a 
Frequency  Responses 
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Figure  73  A-4D  Inverse  Plant  Model  and  Network  2  q 
Frequency  Responses 
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Figure  74  A-4D  Inverse  Plant  Model  and  Network  2  theta 
Frequency  Responses 
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3.   Case  #  5  -  Inverse  Plant  of  the  X-29  Aircraft 

The  fifth  case  also  analyses  an  open-loop  transfer 
function,  the  X-29  fourteen  order  plant.  As  shown  in  Fig.  30 
and  31  of  Chapter  V,  the  A-4D  plant  has  no  unstable  pole  and 
one  non-minimum  phase  zero  at  -3.65,  whereas  the  X-29  plant 
has  one  unstable  pole  at  +1.05  and  three  non-minimum  phase 
zeros  located  at  -4.5,  +2.2,  and  +9.5.  As  a  consequence  of  the 
unstable  pole,  the  X-29  plant  is  unstable.  As  a  consequence  of 
the  size  of  the  X-29  non-minimum  phase  zeros,  +9.5  and  -4.5, 
versus  the  A-4D  non-minimum  phase  zero,  -3.65,  the  degree  of 
instability  of  the  X-29  inverse  plant  is  much  higher  than  the 
degree  of  instability  of  the  A-4D  inverse  plant. 

In  the  inverse  plant  architecture  of  Fig.  29,  the  X-29 
plant  without  controller,  which  has  not  been  modelled  prior  to 
this  case,  is  emulated  with  neural  network  1.  The  X-29  inverse 
plant  is  emulated  with  neural  network  2.  As  shown  in  Fig.  29, 
only  one  input  to  the  plant  is  necessary  to  investigate  this 
case  study.  Both  inputs  to  the  plant  will  be  analyzed  in  the 
third  configuration  when  simulating  the  controllers  and  the 
plant.  The  same  SIMO  and  MISO  neural  network  structures  of  the 
X-29  model  of  case  #3  are  used  in  addition  to  the  same  number 
of  outputs,  2,  and  the  same  sampling  time,  0.02  seconds.  The 
only  exceptions  are  that  the  neural  network  of  level  1 
emulates  a  smaller,  unstable  system  (X-29  plant)  and  that  the 
neural  network  of  level  2  emulates  a  very  unstable  system  (X- 
29  inverse  plant) . 
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After  25,000  epochs  or  300  seconds,  neural  network  1 
has  learned  to  model  the  unstable  X-29  plant  in  the  time 
domain.  The  a  and  g  time  responses  of  the  X-29  plant  model  and 
of  the  network  1  to  a  step  of  0.01  degree  for  one  second 
applied  to  input  1  are  given  in  Fig.  75  and  76.  The  RMS  errors 
are  on  the  order  of  0.0005  for  a  or  5.0  percent  of  the  maximum 
output  value  of  one,  and  on  the  order  of  0.0001  for  g.  Notice 
in  both  figures  the  positive  exponential  departures  of  both 
responses  with  respect  to  time.  This  explains  why  a  step  input 
of  0.01  degree  was  chosen  over  the  step  input  of  one  degree  to 
test  the  system.  These  exponential  responses  can  be  controlled 
by  limiting  the  plant  outputs  to  a  certain  value.  Limiting  the 
plant  outputs  has  two  purposes.  First,  it  avoids  the  plant 
output  signals  to  grow  exponentially.  Second,  since  the  plant 
outputs  become  the  inverse  plant  inputs,  it  limits  the  control 
inputs  of  the  inverse  plant  network  2.  In  this  way  the  effects 
of  the  unstable  inverse  plant  are  restrained. 

In  case  #5  of  the  USERIO  program  of  Appendix  A,  the 
generation  of  the  system  or  plant  outputs  are  limited  to 
values  between  +  1.  Every  time  one  of  the  two  plant  outputs 
reaches  +1,  the  same  output  is  reset  to  zero.  These  resets 
occur  approximately  every  90  epochs  or  1.8  seconds,  which 
introduces  noise  every  0.5  hertz  in  the  frequency  spectrum,  as 
demonstrated  in  Fig.  77  and  78.  The  mean  of  the  noise  dynamics 
in  Fig.  78  follows  the  true  plant  response  to  a  certain  point, 
around  20  hertz.  By  applying  an  adequate  filter,  a  proper 
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frequency  response  of  the  network  could  be  more  or  less 
obtained. 

The  very  unstable  inverse  plant  makes  the  task  of  the 
inverse  plant  network  2  more  difficult.  Even  after  500,000 
epochs  or  8,500  seconds,  neural  network  2  cannot  emulate  the 
inverse  plant,  as  shown  in  Fig.  79.  The  RMS  error  is  on  the 
order  of  0.6  or  60  percent  of  the  maximum  output  of  one. 

In  summary,  the  second  configuration  could  simulate 
case  #3,  the  large  order  and  stable  optimal  performance  X-29 
inverse  closed-loop  transfer  function  and  case  #4,  the  small 
order,  unstable  A-4D  inverse  plant,  but  it  could  not  simulate 
case  #5,  the  more  unstable  X-29  inverse  plant.  The  unstable  X- 
29  plant  was  however  emulated. 
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Figure  79  RB  Inputs  Comparison  after  500K  Epochs  (case  #5) 


B.   CONFIGURATION  #3:  SIMULATIONS  OF  THE  X-2  9  EXISTING 
CONTROLLERS  AND  THE  X-2  9  PLANT 


In  the  simulation  of  the  optimal  X-29  closed-loop  plant  of 
case  #1  and  in  the  simulation  of  the  limited  X-29  closed-loop 
plant  of  case  #2,  the  entire  closed-loop  architecture  of  Fig. 
28  is  emulated,  whereas  in  case  #6  and  #7  each  controller  and 
plant  is  simulated  separately  as  the  open-loop  architecture  of 
Fig.  33.  After  both  the  controller  and  the  plant  are  emulated, 
case  #8  will  close  the  open-loop  model  of  both  cases  by 
connecting  in  series  the  neural  network  representing  the 
controller  and  the  neural  network  representing  the  plant,  and 
by  feeding  back  the  errors  of  the  plant  network  outputs  to  the 
controller  network  inputs,  as  illustrated  in  Fig.  33.  In  the 
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open-loop  architecture  of  Fig.  33,  level  1  emulates  the  X-29 

controller  and  level  2  emulates  the  X-29  plant.  The  neural 

network  representation  of  Fig.  33  is  shown  in  Fig.  34.  The 

first  MIMO  neural  network  structure  of  Fig.  34  simulates  the 

controller  and  the  second  MIMO  neural  network  structure  of 

Fig.  34  simulates  the  plant.  The  optimal  controller  case  #6 

introduces  a  nonlinear  network  model,  whereas  the  limited 

controller  case  #7  utilizes  a  linear  network  model.  In  this 

configuration,  only  the  time  domain  will  be  analyzed  since  the 

interests  are  on  the  time  responses  of  both  inputs  to  case  #8, 

as  described  above. 

1.   Case  #  6  -  Simulation  of  the  X-29  Optimal  Controller 
and  the  X-29  Plant 

This  case  emulates  the  stable  optimal,  controller  at 
level  1  and  the  plant  of  the  X-29  at  level  2.  This  controller 
is  stable  since  the  poles  and  zeros  of  the  transfer  functions 
of  the  two  inputs  are  within  the  unit  circle. 

The  optimal  controller  is  first  emulated  using  a 
linear  neural  network  i.e.  no  hidden  layers.  The  linear  neural 
network  1  has  not  learned  to  model  the  limited  controller  even 
after  200,000  epochs  or  4000  sec,  as  shown  in  Fig.  80  through 
Fig.  83.  The  network  has  difficulties  in  simulating  the 
magnitude  of  the  linear  ramps  of  the  responses  and  the 
magnitude  of  the  excursions.  The  best  example  is  shown  in  Fig. 
82.  The  network  could  learn  the  ascent  of  the  first  peak,  but 
it  could  not  make  the  descent  on  time.  The  difficulties  in 
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simulating  the  excursions  are  due  to  the  fact  that  their  rise 
times  are  approaching  the  sampling  time  of  0.02  seconds. 
Nevertheless,  in  all  four  graphs  the  time  responses  of  the 
controller  network,  network  1,  do  not  show  any  time  shifts. 

Since  the  optimal  controller  could  not  be  emulated 
using  a  linear  network  model,  nonlinearity  was  introduced  to 
see  if  a  nonlinear  network  model  could  bring  better  results. 
Therefore,  two  non-linear  networks  were  investigated  in  this 
case  study. 

The  first  nonlinear  network  involves  the  addition  of 
one  hidden  layer  between  the  control  input  layer  and  the 
output  layer  of  the  controller  MIMO  network  structure  of  Fig. 
34.  The  hyperbolic  tangent  function  is  used  as  the  transfer 
function  of  the  hidden  layer. 

Various  numbers  of  elements  in  the  hidden  layer  have 
been  tested.  The  best  results  were  obtained  within  25,000 
epochs  or  500  seconds  using  42  elements. 

The  time  responses  of  the  X-29  linear,  optimal 
controller  and  of  the  first  nonlinear  controller  network  to  a 
step  input  of  one  degree  for  one  second  are  shown  in  Fig.  84 
through  Fig.  87.  The  RMS  errors  are  on  the  order  of  0.0001  for 
output  1  or  0.01  percent  of  the  maximum  output  of  one,  and 
0.00005  for  output  2.  There  are  some  improvements  from  the 
linear  network  responses  (0  hidden  layer)  to  the  nonlinear 
network  responses  (1  hidden  layer).  Referring  to  the  above 
mentioned  figures,  all  the  linear  ramps  of  the  responses  are 
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well  modelled.   However,   the  peaks1   values  are  not  well 
represented,  as  shown  in  Fig.  86. 

The  second  nonlinear  network  involves  the  addition  of 
two  hidden  layers  between  the  control  input  layer  and  the 
output  layer  of  the  controller  MIMO  network  structure  of  Fig. 
34.  The  first  hidden  layer  from  the  bottom  has  the  same  number 
of  elements  as  the  one  of  the  previous  test,  i.e.,  42.  To 
determine  the  optimal  number  of  elements  in  the  second  hidden 
layer,  a  SVD  analysis  was  carried  out  based  on  the  weight 
connections  of  the  two  hidden  layers. 

The  SVD  was  calculated  for  different  numbers  of 
elements  (30,  21,  12  and  5)  or  trials  using  the  weight 
matrices,  which  are  composed  of  the  connections  weights  of  the 
two  layers.  The  results  are  given  in  Fig.  88  through  91.  In 
all  four  trials,  the  networks  have  been  trained  using  the  same 
learning  rate.  In  all  SVD  plots,  three  lines  stand  out, 
meaning  that  the  optimal  number  of  elements  in  the  second 
hidden  layer  should  be  three.  After  some  oscillations  between 
0  and  1500  epochs,  the  network  in  all  four  trials  (30,  21,  12, 
and  5  elements)  stabilizes  to  constant  values.  For  example,  in 
Fig.  88  the  network  comprising  a  second  hidden  layer  of  30 
elements  stabilizes  around  SVD  5,  3.5,  and  0.5. 

Therefore,  forty-two  elements  in  the  first  hidden 
layer  and  three  elements  in  the  second  hidden  layer  should  be 
sufficient  to  represent  the  second  nonlinear  network  model  (2 
hidden  layers) . 
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The  time  responses  of  the  X-29  linear,  optimal 
controller  and  the  second  nonlinear  network  1  to  a  step  input 
of  one  degree  for  one  second  are  shown  in  Fig.  92  through  Fig. 
95.  The  RMS  errors  are  on  the  order  of  0.001  for  output  1  and 
0.0004  for  output  2.  The  responses  are  very  similar  to  the 
first  nonlinear  network  1  (1  hidden  layer).  Comparing  Fig.  92 
with  Fig.  84,  Fig.  93  with  Fig.  85,  and  Fig.  95  with  Fig.  87, 
the  linear  ramps  of  the  two  nonlinear  networks  are  well 
modelled  but  the  peaks  are  not  well  represented.  Comparing 
Fig.  94  with  Fig.  86,  both  networks  responded  with  high  peak 
values  which  are  not  present  in  the  true  optimal  controller 
responses.  As  with  the  first  nonlinear  network  (1  hidden 
layer) ,  no  time  shifts  are  found. 

The  second  part  of  case  #6  involves  the  simulation  of 
the  X-29  unstable  plant  at  level  2,  as  shown  in  Fig.  33.  In 
the  X-29  plant  of  case  #5  only  one  input  to  the  plant  was 
necessary  to  investigate  the  case,  whereas  in  case  #6,  case  #7 
and  case  #8  both  inputs  to  the  plant  are  necessary.  After 
4  0,000  epochs  or  800  seconds,  network  2  has  learned  to  model 
the  unstable  X-29  plant  using  a  MIMO  network  structure  rather 
than  a  SIMO  structure  as  in  the  X-29  plant  case  #5.  It  took  as 
long  to  train  the  SIMO  network  structure  as  to  train  the  MIMO 
structure.  The  q  and  a  time  responses  of  the  X-29  plant  model 
and  of  neural  network  2,  which  emulates  the  plant,  to  a  step 
of  0.01  degree  for  one  second  applied  to  input  2  are  given  in 
Fig.  96  and  97.  The  responses  to  input  1  were  given  in  the  X- 
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29  plant  model  of  case  #5.  Once  again,  both  responses  have  an 
exponential  departure  with  respect  to  time.  This  time,  the 
departures  are  in  the  opposite  direction.  As  with  case  #5,  the 
plant  outputs  were  limited  to  values  +  1  to  control  the 
negative  exponential  responses. 


Ill 


Figure  80  X-29  Optimal  Controller  Model  and  Network  1  a   Time 
Responses  to  Input  1  (  0  Hidden  layer  ) 
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Figure  81  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  1  (  0  Hidden  layer  ) 
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Figure  82  X-29  Optimal  Controller  Model  and  Network  1  a  Time 
Responses  to  Input  2  (  0  Hidden  layer  ) 


Figure  83  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  2  (  0  Hidden  layer  ) 
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Figure  84  X-29  Optimal  Controller  Model  and  Network  1  a  Time 
Responses  to  Input  1  (  1  Hidden  layer  ) 


~3 

5 

■■J 
•J 

u 

u 

Ui 

=0 
1) 

Q 


150 

100 

50 

0 

-50  |j 
-100 
-150 
-200 
-250 
.30«»0 


- 

X-29  - 

■ 

Network  1  _ 

jl 

1 

'  \ 

■k- 

- 

.•mp*- 

Ir^x ' 

N 

i 

Time  -  sec 


Figure  85  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  1  (  1  Hidden  layer  ) 
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Figure  86  X-29  Optimal  Controller  Model  and  Network  1  a  Time 
Responses  to  Input  2  (  1  Hidden  layer  ) 
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Figure  87  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  2  (  1  Hidden  layer  ) 
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SVD  plot  of  the  wgt  matrix  (hidden  2  -  30  elements) 
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Figure  88  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2-  30  elements) 


SVD  plot  of  the  wgt  matrix  (hidden  2-21  elements) 
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Figure  89  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2-  21  elements) 
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SVD  plot  of  the  wgt  matrix  (hidden  2  -  12  elements) 
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Figure  90  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2-  12  elements) 


SVD  plot  of  the  wgt  matrix  (hidden  2  -  5  elements) 
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Figure  91  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2-  5  elements) 
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Figure  92  X-29  Optimal  Controller  Model  and  Network  1  a   Time 
Responses  to  Input  1  (  2  Hidden  layer  ) 
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Figure  93  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  1  (  2  Hidden  layer  ) 
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Figure  94  X-29  Optimal  Controller  Model  and  Network  1  a   Time 
Responses  to  Input  2  (  2  Hidden  layer  ) 
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Figure  95  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  2  (  2  Hidden  layer  ) 


119 


-5 


-6 


-2 

X-29  — 

Network  2 

UJ 
OS 

o 

LU 

-3 

-4 

To  a  Step  Input  of  0.01  degree  for  1  sec 


0.5 


1.5  2  2.5 

TIME  -  SEC 


3.5 


Figure  96  X-29  Plant  Model  and  Network  2  a  Time 
Responses  to  Input  2 
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Figure  97  X-29  Plant  Model  and  Network  2  q  Time 
Responses  to  Input  2 
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2.   Case  #  7  -  Simulation  of  the  X-29  Limited  Controller 
and  the  X-29  Plant 

This  case  emulates  the  stable,  limited  controller  at 
level  1  and  the  plant  of  the  X-29  at  level  2,  as  shown  in  Fig. 
33.  The  controller  is  stable  because  the  poles  and  zeros  of 
the  two  inputs  are  within  the  unit  circle. 

Network  1  has  learned  to  model  the  limited  controller 
within  20,000  epochs  or  400  seconds,  as  shown  in  Fig.  98 
through  101.  The  RMS  errors  are  on  the  order  of  0.001  for  a 
and  on  the  order  of  0.0005  for  g.  Comparing  the  four  figures, 
the  a  and  q  time  responses  to  input  1  show  near  to  exact 
solutions,  whereas  the  a  and  g  time  responses  to  input  2  show 
minor  deviations  from  the  true  limited  controller  model. 
Further  training  did  not  better  the  results  of  input  2. 
Nonlinearity  was  also  introduced  to  network  1  emulating  the 
limited  controller  by  adding  hidden  layers  ,  but  no 
improvement  to  the  present  results  were  found. 

The  second  part  of  case  #7  involves  the  simulation  of 
the  X-29  unstable  plant  at  level  2,  as  shown  in  Fig.  33.  After 
40,000  epochs  or  800  seconds,  network  2  has  learned  to  model 
the  unstable  X-29  plant  using  the  same  MIMO  network  structure 
than  the  optimal  case  #6.  As  with  case  #6,  the  output  values 
of  the  plant  were  limited  to  +1  to  control  the  exponential 
departures  of  the  responses. 
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Figure  98  X-29  Limited  Controller  Model  and  Network  1  a  Time 
Responses  to  Input  1 
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Figure  99  X-29  Limited  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  1 
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Figure  100  X-29  Limited  Controller  Model  and  Network  1  a 
Time  Responses  to  Input  2 
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Figure  101  X-29  Limited  Controller  Model  and  Network  1  q 
Time  Responses  to  Input  2 
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3.   Case  #8  -  Closure  of  the  Open-Loop  Model  of  the 
Optimal  Controller  of  Case  #6  and  of  the 
Limited  Controller  of  Case  #7 

After  both  the  controller  and  the  plant  of  case  #6  and 
#7  are  emulated,  case  #8  will  close  the  open-loop  model  of 
both  cases  by  connecting  in  series  the  neural  network 
representing  the  controller  and  the  neural  network 
representing  the  plant,  and  by  feeding  back  the  errors  of  the 
plant  network  outputs  to  the  controller  network  inputs,  as 
illustrated  in  Fig.  33. 

Case  #8  is  divided  in  two  parts.  The  first  part 
examines  the  closure  of  the  open-loop  model  of  the  optimal 
controller  of  case  #6,  and  the  second  part  examines  the 
closure  of  the  open-loop  model  of  the  limited  controller  of 
case  #7.  These  operations  are  performed  in  case  #8  of  the 
USERIO  program. 

In  the  first  part  of  case  #8,  since  the  X-29  optimal 
controller  could  not  be  modelled  exactly  by  the  linear  (0 
hidden  layer)  or  the  two  nonlinear  networks  (1  and  2  hidden 
layers)  of  case  #6,  no  solution  to  the  closure  of  the  open- 
loop  model,  case  #8,  was  obtained.  As  mentioned  previously, 
the  peak  values  could  not  be  well  represented  in  the  optimal 
controller  of  case  #6  since  the  excursions'  rise  times  were 
too  close  to  the  sampling  time  of  0.02  seconds. 

In  the  second  part  of  case  #8,  since  the  linear  neural 
network  1  of  case  #7  has  learned  to  model  the  limited 
controller  very  well,  a  solution  to  the  closure  of  the  open- 
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loop  model  was  obtained.  The  limited  performance  X-29  closed- 
loop  model  and  the  networks'  a  and  q  time  responses  to  input 
1  and  2  are  given  in  Fig.  102  through  105.  Referring  to  Fig. 
98  through  101  of  the  limited  performance  case  #7,  the  minor 
deviations  of  the  network  time  responses  from  the  true  model 
explain  the  small  time  shifts  occurring  in  the  closure  of  the 
open-loop  model  responses,  as  shown  in  Fig.  102  through  105. 
In  summary,  the  third  configuration  could  simulate 
case  #7,  the  X-29  limited  controller  and  the  X-29  unstable 
plant,  and  case  #8  part  II,  the  closure  of  the  open-loop  model 
of  case  #7,  with  high  accuracy.  However,  the  third 
configuration  could  not  simulate  the  optimal  controller  of 
case  #6  sufficiently  to  permit  case  #8  part  I,  the  closure  of 
the  open-loop  model  of  case  #6,  to  take  place. 
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Figure  102  X-29  Closed-Loop  Model  and  Networks  a   Time 
Responses  to  Input  1  (  Limited  case  ) 
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Figure  103  X-29  Closed-Loop  Model  and  Networks  q  Time 
Responses  to  Input  1  (  Limited  case  ) 
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Figure  104  X-29  Closed-Loop  Model  and  Networks  a  Time 
Responses  to  Input  2  (  Limited  case  ) 
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Figure  105  X-29  Closed-Loop  Model  and  Networks  q  Time 
Responses  to  Input  2  (  Limited  case  ) 
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VII.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  neural  network  structures  developed  in  this  thesis 
demonstrate  the  ability  of  parallel  distributed  processing  in 
solving  adaptive  control  problems.  Adaptive  control  theory 
implied  a  combination  of  a  control  method  and  a  model 
estimation.  The  control  method  chosen  was  the  Lyapunov  Model 
Reference  Adaptive  Control  (MRAC)  in  which  the  system  was 
forced  to  follow  the  reference  model  with  zero  error.  The 
controller  itself,  the  weighted  one  step  ahead  prediction 
controller,  involved  the  weighted  sum  of  the  state  variables 
and  the  reference  input.  The  model  estimation  chosen  was  the 
linear  least  square  estimate  in  which  the  predicted  output 
became  the  weighted  sum  of  the  terms  in  the  regression  vector. 
These  weights  were  adjusted  by  minimizing  the  error  between 
the  network  and  the  true  X-29  responses.  The  implementation  of 
the  neural  network  adaptive  control  structure  was  demonstrated 
on  the  longitudinal  dynamics  of  the  X-29  fighter  aircraft. 

Three  configurations  were  proposed  to  train  the  neural 
network  adaptive  control  structures  to  provide  the  appropriate 
inputs  to  the  unstable  X-29  plant  so  that  desired  responses 
could  be  obtained.  These  configurations  were  presented  in 
eight  cases.  The  first  configuration  representing  the  closed- 
loop  architecture  of  Fig.  28  could  simulate,  with  a  linear 
network  model,  the  large  order  and  stable  optimal  and  limited 
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performance  X-29  closed-loop  plants  with  high  accuracy.  The 
networks'  time  and  frequency  responses  of  both  performance 
cases,  case  #1  and  case  #2,  developed  near  to  exact  model 
solutions. 

The  second  configuration  representing  the  inverse  plant 
architecture  of  Fig.  29  could  simulate  in  both  time  and 
frequency  domain  the  large  order  and  stable  optimal 
performance  X-29  inverse  closed-loop  transfer  function,  case 
#3,  and  the  small  order,  unstable  A-4D  inverse  plant,  case  #4. 
However,  the  second  configuration  could  not  simulate,  neither 
with  a  linear  nor  a  nonlinear  network  model,  the  more  unstable 
X-29  inverse  plant,  case  #5. 

Since  the  degree  of  instability  of  the  X-29  inverse  plant 
is  much  higher  than  the  degree  of  instability  of  the  A-4D 
inverse  plant,  the  simulation  of  the  inverse  plant  of  the  A-4D 
aircraft  could  be  achieved  easily  compared  to  the  X-29 
aircraft,  whose  inverse  plant  could  not  be  simulated. 

The  last  configuration  representing  the  open-loop 
architecture  of  Fig.  33  could,  with  a  linear • network  model, 
simulate  the  X-29  limited  controller  and  the  X-29  unstable 
plant,  case  #7,  with  high  precision.  In  the  optimal  controller 
of  case  #6,  the  nonlinear  neural  networks,  which  were  used  to 
model  the  linear  system,  performed  better  than  the  linear 
network  model. 

The  use  of  the  SVD  analysis  was  successful  in  determining 
the  optimal  number  of  elements  in  the  hidden  layers. 
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Further  studies  are  needed  to  develop  improved 
combinations  of  linear  and  nonlinear  neural  network 
structures.  In  addition,  it  is  important  to  pursue  research  on 
ways  of  reducing  the  computational  time  by  means  of  selecting 
the  proper  number  of  elements  in  the  hidden  layers  or  by  means 
of  selecting  the  proper  learning  rates. 


130 


REFERENCES 


1.  Scott,  R.  W.  ,  Application   of  Neural    Networks    to 
Adaptive   Control,    Aeronautical  Engineer  Thesis, 
Naval  Postgraduate  School,  Monterey  Ca.,  December 
1989. 

2.  Rogers,  W.  L.  ,  Application  of  Modern   Control   Theory 
Synthesis   to  a   Super-Augmented  Aircraft,    Aeronautical 
Master  Thesis,  Naval  Postgraduate  School,  Monterey  Ca., 
June  1989. 

3.  Wasserman,  P.  D. ,  Neural    Computing:    Theory  and  Practice, 
Anza  Research,  Inc.,  1989. 

4.  Klimasauskas,  C,  and  others,  Neuralworks   Professional 
II  Manual,    Neuralware,  Inc.,  1988. 

5.  Kraft,  L.  G. ,  and  Campagna,  D.  P.,  "A  Comparison  Between 
CMAC  Neural  Network  Control  and  Two  Traditional  Adaptive 
Control  Systems",  IEEE  Control   Systems   Magazine,    April 
1990,    The  Institute  of  Electrical  and  Electronic 
Engineers,  Inc.,  1990. 

6.  Goodwin,  G.  C,  and  K.  S.  Sin,  Adaptive   Filtering: 
Prediction   and  Control,    Prentice-Hall,  Inc.,  1984. 

7.  Ljung,  L. ,  System   Identification:    Theory  for   the   User, 
Prentice-Hall,  Inc.,  1987. 

8.  Jane's  All    the  World's  Aircraft   1987-1988,    pp.  430-432, 
Jane's  Information  Group  Limited,  1988. 

9.  Aviation   Week    &   Space   Technology,    January   7,  1985,    pp. 
47-48,  McGraw  Hill  Publication,  1985. 

10.  W.L.  Rogers  and  D.J.  Collins, "X-29   Hm  Controller 
Synthesis" , paper  presented  ... 

11.  Chiang,  R.  Y.,  and  Safonov,  M.  G. ,  Robust-Control 
Toolbox,    User's   Guide,    pp.  R4-R33,  The  Mathworks,  Inc., 
June  1988. 

12.  Sun  Microsystems,  Inc.,  The  SPARC  Station   II    ,1991. 


131 


13.  Moler,  C. ,  J.  Little,  and  S.  Bayert,  Pro-MATLAB   User's 
Manual,    The  Mathworks,  Inc.,  1987. 

14.  Miller,  W.  T. ,  and  others,  Neural   Networks   for  Control, 
The  MIT  Press,  1990. 


132 


APPENDIX  A:  NEURALWORKS  PROFESSIONAL  II  USERIO  PROGRAM 


Source: 

Executable: 

Version: 

Date: 

Author: 

Project: 

Environment: 

Path: 

Description: 


'A****************************************************************************** 

* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 

* 
* 
+ 
* 
* 
* 

* 


simoMonika . c 

sinioMonika 

3.1 

30  August  1991 

D.  Bertrand 

Neural  Networks  in  Adaptive  Control 

UNIX/SunOS  C 

eileen: /f il669/home/Monika 

This  is  a  prototype  for  the  USERIO  program  spawned  by 

NWORKS  Professional  II  to  provide  input  and  output 

vectors  for  the  use  of  an  adaptive  control  neural  network. 

The  program  operates  by  running  a  simulation  of  the 

longitudinal  dynamics  of  the  X-29  and  A-4  aircrafts  at  the 

same  speed  as  sampling  time  of  the  network. 

The  program  can  be  used  for  any  SIMO  and  MIMO  linear  and 

non-linear  models. 

This  USERIO  program  has  been  divided  into  cases: 


<  Level  1  &  2  represent  two  networks  superimposed  > 


case  (c#) 
1,2 


level  1 


level  2 


X-29,  30  states 

closed-loop  conf. 

(optimal  &  limited) 

X-29,  30  states 
closed-loop  conf.. 
(optimal) 


control  strat, 
contstrl 


remarks 


A4  plant 


X-29  Plant 


X-29  inverse 
closed-loop  conf 

Inverse  Plant 

Inverse  Plant 


contstrl 


contstr2 


only  Level  1 
is  trained 


to  train  Level  1 


to  train  Level  2 


contstrl 

to 

train 

Level 

1 

contstr2 

to 

train 

Level 

2 

contstrl 

to 

train 

Level 

1 

contstr2 

to 

train 

Level 

2 

6,7      X-29  Controllers 

(Optimal  &  Limited) 


ii    ii    ii    it    it    ii 


case    3,4,5 


X-29   Plant 


ii    ii    ii    ii 


contstr2   to  train  each  Level 
individually 

••    ••    ••    ••        to  test   case   6f7: 

connect  in  series  &  feedback 


In  these  three  cases,  two  major  operations  are  performed  : 

-connecting  the  plant  and  the  inverse  plant  networks  in  series 
-presenting  the  desired  output  to  the  inverse  plant  network. 

These  operations  are  accomplished  in  the  case  request 

RQ_LEARNRSLT  when  identifying  the  output  layer, 


if(IOCOUNT  ==  NUM_OUT  &&  IOLAYER  ==  out_lay) { 
...  for  (i=0;  i<num  out;  i++) { 


command2 [ i )=out [ i] ; 


} 

out2 [ 0 ] =command [ 0 ] ; 


.meaning  that  alpha(t)  and  q(t) 
become  the  input  of  the  inverse 
plant. 

.meaning  that  r(t-l),  the  ref. input 
becomes  the  desired  output  of  the 
inverse  plant. 
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* 

* 
* 
* 
* 

* 
* 

* 
* 
* 
* 
* 
* 

* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 

** 


case  6  &  7 


case  8 


In  these  two  cases,  both  networks  are  trained  separately. 
The  connections  between  the  networks  will  be  done  in  case  #8, 


In  this  case,  two  major  operations  are  performed  on  case  #647: 
-connecting  the  controller  and  the  plant  networks  in  series, 
-feeding  back  to  the  controller  inputs  the  error  between  the 
network  plant  outputs  and  the  reference  inputs 
These  operations  are  accomplished  in  the  case  request 
RQ_LEARNRSLT  when  identifying  the  plant  and  the  controller  layers 

if(IOCOUNT  ==  num_out  &&  IOLAYER==out_lay) { 
...  for(i=0;  i<num_out;  i++) { 

command2 [ i]=out [ i ] ;  ..meaning  that  the  controller  outputs 

become  the  plant  inputs. 
} 

if(IOCOUNT  ==  num_out2  &&   I0LAYER==out2_lay) { 

...for(i-0;  i<num_out2;  i++) { 

command [ i]=command[ i ]-out2 [ i] ;. .meaning  that  the  controller 

inputs  become  the  error 
between  the  plant  outputs 
and  the  reference  in  puts. 


Three  different  inputs  are  available: 

Input  1  -  Random  Binary 

Input  2  -  test  input  1  with  a  pulse  of  1  degree  for  1  sec 

Input  3  -  test  input  2  with  a  pulse  of  1  degree  for  1  sec 

A***********************  ♦**********+***************  **********  **************** 


/*  Include  the  following  external  modules  */ 


fine 
fine 
Zinc 
/*  * 


/* 
/* 
/* 
/* 
/* 


Zinc 


lude  <stdio.h> 
lude  <math.h> 
lude  "userutl.h" 
include  "transf er30hp. h" 
include  "transf er30lim.h" 
include  "transferhplinv.h" 
include  "transf erA4inv.h" 
include  "transf erl4inv. h" 
include  "transf erl614hp.h" 
lude  "transferl614hp.h" 


File  of  parameters  for  case  1  (optimal) 

File  of  parameters  for  case  2  (limited) 

File  of  parameters  for  case  3  (X29)*/ 

File  of  parameters  for  case  4  (A4)*/ 
File  of  parameters  for  case  5   (X29)*/ 

File  of  parameters  for  case  6  (Optimal)*/ 

File  of  parameters  for  case  7  (Limited)*/ 


*/ 
*/ 


/*  Neuralworks  calls  the  USERIO  program  through  the  function  UsrIO  */ 

int  UsrIO() 
{ 


/*  Declarations  */ 

extern  double  ts; 

extern  double  iterations; 

extern  double  pow(); 

extern  double  f mod ( ) ; 


/*  Sampling  time  */ 

/*  number  of  iterations  */ 

/*  Power  function  */ 

/*  Remainder  function  */ 
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extern  long  random)) ;  /*  Random  number  generator  */ 

extern  char  *input_name [ ] ;       /*  Names  of  inputs  */ 
extern  double  numl [num_in] [ num_out] [ordl J ; /*  Numerator  coefficients 
extern  double  denl[ordl];  /*  Denominator  coefficients 

extern  double  num2 [num_in2 J [num_out2 ] [ord2 ] ; /*  Numerator  coefficients 
extern  double  den2[ord2];  /*  Denominator  coefficients 

extern  double  alphal;  /*  Place  holder  for  Commandf]*/ 

extern  double  alpha2;  /*  Place  holder  for  Command[]*/ 

extern  double  alpha3;  /*  Place  holder  for  Commandf]*/ 


*/ 
*/ 
*/ 
*/ 


static  int  profile={0}; 
static  int  redraw, in={0} ; 
static  double  checkl; 
static  double  check2; 
static  double  count={0.0}; 
static  int  input; 


/*  Redisplay  initialization  flag  */ 

/*  Check  flag  */ 

/*  Check  flag  */ 

/*  Display  counter  */ 

/*  Selected  input  */ 


static  double  rmem, rmeml , rmem2 ;        /*  Counters  for  inputs  */ 
static  double  rcount , rcountl , rcount2 ;   /*  Counters  for  inputs  */ 
int  h,i,j,imax;  /*  Indices  */ 

char  buf[90];  /*  Display  buffer  */ 

char  *sp;  /*  String  pointer  */ 


/*  Feedback  regression  vectors  */ 

static  double  feedback [num_feed]={0 . 0} ; 
static  double  f eedback2 [num_f eed2 ]={0. 0} ; 

/*Ref  input  +  regression  vectors  */ 

static  double  command [num_comd]=  {0.0}; 

static  double  command2 [num_comd2 ]=  {0.0}; 
/*  Regression  vectors  applied  to  NN  */ 

static  double  control [num_cont]=  {0.0}; 

static  double  control2 [num_cont2 ]=  {0.0}; 

/*  Plant  responses  to  regression  vectors  *./ 

static  double  out [num_out ]={0. 0} ; 
static  double  out2 [num_out2]={0. 0} ; 


/*  Definitions  */ 

/define  MAXRAND  (0x7f f f f f f f 1) 
/define  rand  random 


/*  Definitions  of  Level  l  */ 


/define  feedback_lay  0 
/define  command_lay  1 
/define  control_lay  2 


/define  out_lay  3 


/*  /define  hiddenl_lay  3   For  non-linear  models  */ 
/*  /define  hidden2_lay  4  */ 
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/*  Definitions  of  Level  2  */ 

/define  f eedback2_lay  4 
/define  coinmand2_lay  5 
/define  control2_lay  6 
/define  out2  lay  7 


/*  initialization  (if  necessary)  */ 
IORTNCDE  =  0; 

switch  (  IOREQCDE  )  { 

/*  

case  RQ_ATTENTION: 

/*  User  select  input  to  be  used  */ 

Again3 : 

sprintf(  buf , "\nEnter  Desired  Input  Type  (1.  %s,  2.  %s,  3.  %s,  4.  %s" 

input_name [ 1 ] , input_name [ 2 ] , input_name [  3  ] )  ; 
PutStr(  buf  ) ; 
sp=GetStr ( ) ; 

sscanf (  sp,  "%ld",  &input) ; 
if(  input  >3.  ||  input<l.  ){ 

sprintf(   buf,  " \n%s" , input_name [ 0]  ); 

PutStr (  buf  ) ; 

for(i=0;i<1000;i++) { 

} 

goto  Again3; 

} 

/*  Display  selections  */ 

sprintf(  buf , "\nlnput :   %s   selected", 

input_name [ input ] ) ; 
PutStr (  buf  ) ; 
if(input==2.     input==3.){ 

PutStr ("\nEnsure  LR  is  set  to  zero  for  test"); 
} 

in=l  ; 
break; 

case  RQ_REWIND: 

/*  Occurs  at  the  start  of  a  "learn  all". 
*  Rewind  any  input  files  to  the  beginning.  */ 

count=0 . 0; 
break; 

case  RQ_LSTART: 
/*  Learn  start;  occurs  once  at  the  start    */ 
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/*  initialize   input  if  not  already  done  so  */ 

if (in==0) { 

input =1 ; 
in=l ; 

} 
/*  check  if  user  wishes  to  redisplay  after  every  plot  reaches  the  end  */ 

PutStr ("\nHow  often  do  you  wish  to  redraw  the  screen  (0  for  never)?"); 

sp=GetStr ( ) ; 

sscanf (  sp,  "%ld",  Sredraw) ; 

/*  start  random  binary  or  composite  in  time  sequence  */ 

if (num_in==l) { 
if (input==l) { 

rcount=0 . 0 ; 
rmem=rand()  %  4; 
command [ 0]=pow(-l . 0, rmem) ; 
} 
} 

if (num_in==2) { 
if (input==l) { 

rcountl=0. 0; 

rcount2=0. 0; 

rmeml=rand ( )  %  4 ; 

rmem2=rand()  %  4; 

command [ 0]=pow (-1 . 0 , rmeml) ; 

command [ l]=pow(-l . 0, rmem2) ; 

if(c==6  | |  C==7) { 

comma nd2 [ 0]=pow(-l . 0, rmeml) ; 
command2 [ 1 ]=pow(-l . 0, rmem2 ) ; 
} 
} 
} 

/*  start  test  with  a  pulse  of  1  degree  for  1  sec  */ 

if (num_in==l) { 
if (input==2) { 

rcount=50. 0; 
command [ 0 ] =alphal  ; 

} 
} 

if (num_in==2) { 
if (input==2) { 

rcountl=50. 0; 
rcount2=50 . 0; 
command [ 0 ]=alphal  ; 
command [ 1 ]=0. 0; 
if(c==6  | |  c==7){ 

command2 [ 0]=alpha3 ; 
command2 [ 1]=0. 0; 
} 
} 
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if (input==3) { 


rcountl=50. 0; 
rcount2=50. 0; 
command [ 1 ] =alpha 1 ; 
command [ 0]=0. 0 ; 
if (c==6  | |  c==7) { 

command2 [ 1 ]=alpha3 ; 

command2 [ 0]=0. 0; 

} 


/*  display  the  starting  conditions  */ 


sprintf(  buf,  "\nCycles:   %f   Input:   Is", 

count,  input_name [ input ]) ; 
PutStr(  buf  ) ; 
break; 


/ 


*- 


case  RQ_LEARNIN: 
/*  The  input  values  should  be  stored  in  IODATA  array   */ 

/*  input  feedback  layers  to  the  network  */ 

if(  IOLAYER==feedback_lay  &&  I0C0UNT==num_f eed  ){ 
for(  i=0;  i<num_f eed; i++  ){ 

IODATA[i]=feedback[i] ; 

} 
} 

if(  IOLAYER==feedback2_lay  &&  IOCOUNT=^num_f eed2  ){ 
for(  i=0;  i<num_feed2 ; i++  ){ 

IODATA[ i ]=feedback2 [i] ; 

} 
} 

/*  input  commmand  layers  to  the  network  */ 

if(  IOLAYER==command_lay  &&  IOCOUNT==num_comd) { 
f or (i=0; i<num_comd; i++) { 

IODATA [ i ] =command [ i ] ; 

} 
} 

if(  IOLAYER==command2_lay  &&  IOCOUNT==num_comd2 ) { 
for (i=0; i<num_comd2 ; i++) { 

IODATA [ i]=command2 [ i] ; 

} 
} 

break; 
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case  RQ_WRSTEP: 
/*  output  control  layer  from  network  */ 
break; 
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case  RQ_LEARNOUT: 
/*  present  plant  or  model  responses  to  the  network  */ 

if(  IOLAYER==out_lay  &&  IOCOUNT==num_out) { 

f or ( i=0 ; i<num_out ; i++) { 

IODATA[ i]=out[ i] ; 

} 
} 

if(  I0LAYER==out2_lay  &&  I0C0UNT==num_out2 ) { 
for ( i=0 ; i<num_out2 ; i++) { 
IODATA[i]=out2[i] ; 
} 

} 

break ; 


r 


case  RQ_LEARNRSLT: 
/*  control  outputs  from  network  */ 

if(  IOLAYER==control_lay  &&  IOCOUNT==num_in) { 

if (num_in==l ) { 

for (i=0; i<num_cont ; i++) { 

control [ i ]=command [  i  ]  ; 

} 

control [0]=IODATA[0] ; 
} 

if (num_in==2) { 
imax=ordl ; 
if  (num_out==l) { 

imax=reg_vecl; 
} 
for  ( i=0; i<imax; i++) { 

control [ i ]=command [ i+num_out-l] ; 
} 

for  ( i=2 ; i<num_in+l ; i++) { 
imax=ordl*i ; 
if  (num_out==i ) { 

imax=reg_vecl ; 
} 
if  (num_out>i-l) { 

for  ( j=ordl* (i-1) +1 ; j<imax; j++) { 

control [ j ] =command [ j  +num_out-i ] ; 
} 
} 
} 

for    (i=0; i<num_in; i++) { 
control [ordl*i]=IODATA[i] ; 
} 
} 
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/*  generate  system  and  model  response  to  this  control  input  */ 

f or (i=0; i<num_out; i++) { 
out [ i ]=0. 00; 
f or (h=0;h<num_in;h++) { 
for ( j=0; j<ordl; j++) { 
out[i]=out[i]+numl[h] [i] [ j ]* (control [ordl*h+j ] ) ; 
} 
} 

for ( j=0; j<ordl; j++) { 
out [ i ]=out[ i )+denl [ j ]* (control [ordl* (i+num_in) +j ] ) ; 
} 
} 


if (IOCOUNT==num_out  &&  IOLAYER==out_lay) { 

/*  shift  the  regression  vectors  */ 

if (num_in==l) { 

f or (i=0; i<num_feed; i++) { 

feedback [ i ]=control [ i] ; 

} 

for  ( i=0 ; i<num_f eed; i++) { 

command [ i+1 ]=control [ i ] ; 

} 
} 

if (num_in>l) { 

for  (i=l; i<num_out+l; i++) { 
imax=ordl*i-l ; 
if  (num  out==i) { 

Tmax=reg_vecl-1 ; 

} 

if  (num_out>i-l) { 

for  ( j=ordl* ( i-1) ; j<imax; j++) { 

f eed back [ j- (i-1) ]=control [ j ] ; 
command [ j+num_out- (i-1) ]=control [ j ] ; 
} 
} 
} 
} 


/*  generate  a  new  random  binary  input  */ 

if (num_in==l) { 
if (input==l) { 

rcount++ ; 

command [ 0 ]=alphal ; 
if (f mod (count, 2.0) <1.0) { 
rmem=rand ( )  %  4 ; 
command [ 0] =pow (-1 . 0,rmem) ; 
alphal=command [ 0] ; 
} 
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if (num_in==2) { 

if (input==l) { 

rcount 1++ ; 

command [ 0]=alphal ; 

command [ 1 ] =alpha2 ; 

if (fmod( count, 2 . 0) <1. 0) { 

rmeml=rand()  %  4; 

rmem2=rand()  %  4; 
command [ 0]=pow(-l. 0, rmeml) 
command [ l]=pow(-l. 0,rmem2) 

alphal=command [ 0] ; 

alpha2=command[ 1] ; 

} 


/*  generate  a  new  test  (pulse  of  1  degree  for  1  sec)  input  */ 

if (num_in==l) { 

if (input==2) { 
rcount  --; 
command [ 0] =alphal ; 
rmem=2  00; 
if (rcount<=0. 0) { 
rmem-- ; 

command [ 0]=0 . 0 ; 
if (rmem<=0. 0) { 
rcount=50 . 0 ; 
alphal=l . 0; 
} 
} 
} 
} 

if (num_in==2) { 
if (input==2) { 

rcountl  --; 
command [ 0]=alphal ; 
command [ 1 ] =0 . 0 ; 
rmeml=2  00; 
if (rcountl<=0. 0) { 
rmeml--; 
command [ 0]=0. 0; 
if (rmeml<=0. 0) { 
rcountl=50. 0; 
alpha  1  =  1 . 0; 
} 
} 
} 

if (input==3) { 
rcountl  --; 
command [ 1 ]=alphal ; 
command [ 0]=0 . 0; 
rmeml=200 ; 
if (rcountl<=0. 0) { 
rmeml--; 
command [ 1 ]=0. 0; 
if (rmeml<=0. 0) { 
rcountl=50. 0; 
alphal=l. 0; 


141 


} 
} 


/*  load  the  regressors  with  system  and  model  responses  */ 

for (i=0; i<num_out ; i++) { 

command [ ordl* ( i+num_in) ]=-out [ i ] ; 
feedback [ ordl* ( i+num_in) -num_in]=-out [ i ] ; 

} 


/*  load  the  input  of  Level  1  to  the  output  of  Level  2  */ 

if (c==3  | |  c==4  | |  c==5) { 

out2 [O]=command[0] ; 

} 

/*  load  the  outputs  of  Level  1  to  the  inputs  of  Level  2  */ 

if (c==3  | |  c==4  | |  c==5  | |  c==8  | |  ){ 
for ( i=0; i<num_out ; i++) { 
command2 [ i ]=out [ i ] ; 
} 

} 

/*  increment  the  counter  and  update  displays  as  necessary  */ 

count++ ; 

check l=f mod (count, 1000. ) ; 

if  (checkKl  .0)  { 

sprintf(  buf,  "\nCycles:   %f   Input:   %s", 
count , input_name [ input ] ) ; 
PutStr  (  buf  ) ; 

if (c==5  | |  c==6  | |  c==7) { 
if (input==l) { 

for ( i=0 ; i<num_out ; i++ ) { 

if (out[ i]>l.O  ||  out[i]<-1.0) { 

for  ( i=0; i<num_f eed; i++) { 

f eedback[ i]=0. 0; 
command [ i+num_in]=0. 0; 
} 

} 
} 
} 
} 

if (redraw  !=0) { 

if (fmod (count , (double) redraw) <1 . 0) { 
IORTNCDE=l; 

} 
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ONLY  FOR  CASES  3  TO  8 


if(  IOLAYER==control2_lay  £.&  IOCOUNT==num_in2  ){ 

imax=ord2 ; 

if  (num_in2==l) { 

imax=reg_vec2 ; 

} 

for  (i=0; i<imax; i++) { 

control2 [ i ] =command2 [ i+num_in2-l ] ; 

} 

for  (i=2 ; i<num_in2+l ; i++) { 

imax=ord2*i ; 

if  (num_in2==i) { 

imax=reg_vec2 ; 

} 

if  (num_in2>i-l) { 

for  ( j=ord2* (i-1) +1 ; j<imax; j++) { 

control2 [ j ]=command2 [ j+num_in2-i] ; 
} 
} 
} 

for  ( i=0 ; i<num_in2 ; i++){ 
control2 [ord2*i]=I0DATA[ i] ; 
} 

/*  generate  system  and  model  response  to  this  control2  inputs  */ 

if (c==6   | |  c==7  | |  c==8){ 

for (i=0; i<num_out2 ; i++) { 
out2[i]=0.00; 
f or (h=0;h<num_in;h++) { 
for ( j^O; j<ord2 ; j++) { 
out2[i]=out2[i]+num2[h] [i] [ j]* (control2 [ord2*h+j ] ) ; 
} 
} 

for ( j=0; j<ord2 ; j++) { 
out2 [ i ] =out2 [ i ] +den2 [ j ] * (control2 [ ord2  * ( i+2 ) + j ] ) ; 
} 
} 
} 


if (I0C0UNT==num_out2  &&  I0LAYER==out2_lay) { 

/*  shift  the  regression  vectors  */ 

for  ( i=l ; i<num_out+l; i++) { 
imax=ord2*i-l ; 
if  (num_out==i) { 

imax=reg_vec2-l; 

} 

if  (num_out>i-l) { 

for  ( j=ord2* (i-1) ; j<imax; j++) { 

feedback2[ j-(i-l) ]=control2 [ j ] ; 
command2[ j+num_out- ( i-1) )=control2 [ j ) ; 

} 
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/*  generate  a  new  random  binary  input  */ 

if (c==6  | |  c==7) { 
if (input==l) { 

rcount2++ ; 


command 2 [0]=alphal ; 
command 2 [ 1 ]=alpha2 ; 
if (fmod( count, 2 .0) <1.0) { 

rmeml=rand()  %  4; 

rmem2=rand()  %  4; 
command2 [0]=pow(-l. 0,rmeml) 
command2 [ 1 ]=pow (-1 . 0 , rmem2 ) 

alphal=command2 [0] ; 

alpha2=command2 [ 1 ] ; 

} 


/*  generate  a  new  test  (pulse  of  1  degree  for  1  sec)  input  */ 

if (c==6  | |  c==7) { 
if (input==2) { 
rcount2  --; 
command 2 [0]=alpha3 ; 
command2 [ 1 ]=0. 0; 
rmem2=200; 
if (rcount2<=0.0) { 
rmem2-- ; 

command2 [ 0]=0 . 0 ; 
if (rmem2<=0.0) { 
rcount2=50.0; 


alpha3=0.001 


} 


} 
} 

if ( input==3) { 
rcount2  --; 
command 2 [ l]=alpha3 ; 
command2 [ 0]=0. 0; 
rmem2=200; 
if (rcount2<=0. 0) { 
rmem2-- ; 

command2 [ 1 ]=0 . 0 ; 
if (rmem2<=0. 0) { 
rcount2=50. 0; 
alpha3=0.001; 


} 


} 


/*  load  the  regressors  with  system  and  model  responses  */ 

if (c==3  | |  c==4  | |  c==5) { 

command 2 [ ordl*num_out ]=-out2 [0] ; 
feedbacks  [ (ordl-1) *num_out ]=-out2 [0] ; 

} 

if (c==6  | |  c==7  | |  c==8) { 

for (1=0; i<num_out2 ; i++) { 

command 2 [ord2* (i+2) ]=-out2 [i] ; 
feedback2[ord2*(i+2)-2]=-out2[i] ; 
} 
} 
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/*  calculate  the  error  value  going  into  the  controller  (feedback  loop)  */ 

if (c==8){ 

for  (i  =  0  ;  i<nuin_out2  ;  i++)  { 

command [ i ] =command [ i ] -out2 [ i] ; 

} 
} 

/*  increment  the  counter  and  update  displays  as  necessary  */ 

if (c==6  | |  c==7) { 
if (input==l) { 

for (i=0; i<num_out2 ; i++) { 

if (out2[i]>1.0  ||  out2[i]<-1.0) { 

for  ( i=0 ; i<num_f eed2 ; i++) { 

feedback2[i]=0.0; 
command2 [ i+num_in]=0. 0; 
} 


} 


} 
} 
} 


break ; 


/ 


* . 


case  RQ_LEND: 

/*  end  learning  mode,  display  current  status  */ 

sprintf(  buf,  "\nCycles:   %f   Input:   %s", 
count,  input_name[ input] ) ; 
PutStr (  buf  ) ; 

break; 

case  RQ_RSTART: 

break; 

case  RQ_READ: 
break; 

case  RQ_WRITE: 
break; 
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case  RQ_RCLTST: 
break ; 

case  RQ_REND: 

/*  end  recall  ,  display  current  status  */ 

sprintf(  buf,  "\nCycles:   %f   Input:   %s", 
count,  input_name[ input] ) ; 
PutStr(  buf  ) ; 

break; 

case  RQ_TERM: 

/*  terminate  userio  */ 

sprintf(  buf,  "\nCycles:   %f", 
count) ; 
PutStr  (  buf  ) ; 

break; 

} 
return; 
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APPENDIX    B:    NEURALWORKS    PROFESSIONAL    II    CONTROL  STRATEGIES    FILES 


csv2 .  1 
file    format    is   Control    Strategy   Version   2.1 


Source : 

Executable: 

Version: 

Date: 

Author: 

Co-Author 

Project: 

Environment : 

Path: 

Description: 


contstrl . nnc 

neuralworks  professional  II 

2 

30  Aug  1991 

D.  J.  Collins 

D.  J.  Bertrand 

Neural  Networks  in  Adaptive  Control 

UNIX/SunOS/Neuralworks  Control  Strategy 

eileen: /f il669/home/monika 

This  is  a  prototype  control  strategy  for  use  with 

the  simomonika  USERIO  program. 

This  strategy  uses  a  proprietary  language  which  is  covered 

in  some  detail  in  the  Neuralworks  Professional  II  manual. 

This  control  strategy  applies  only  for  cases  1,  2,  3,  4  &  5 

which  require  Level  1  to  be  trained  first. 

Each  network  must  use  the  back-propagation  learning  concept,  and 

possesses  at  least  an  input  or  feedback  layer,  a  control  or 

command  layer,  and  an  output  layer. 


Revisions:    Handles  all  hidden  layers 


MASK     label 
L  saRisa 
Li  aRisa 


op-code  operands 
trace    aux3 
cset    recall, 0 


comment 

!    set  trace  option  to  aux3 

!    recall  count 


Get  inputs  for  Level  1  (learn  and  recall) 


L  saRisa 

lset 

in 

L  saR 

io 

lrnin 

L   Risa 

io 

read 

L  saRisa 

lset 

cur,  1 

L  saR 

io 

lrnin 

L    Risa 

io 

read 

set  feedback  layer  or  input 
get  feedback  vector  learn 
get  feedback  vector  recall 
set  command  layer 
get  command  vector  learn 
get  command  vector  recall 


Start  forward  pass  to  but  not  including  output  layer 


L_saRisa        lset 

L_saR gloopl  math 

L Risa        math 

L_saRisa        lset 
L_saRisa        lcmp 


L  saRisa 


bit 


in 

sum 

lnoise 

sum 

rnoise 

cur,  1 

in, +3 

Sloe 

jpl 

!    set  feedback  layer  or  input 
tran  output  e=0|fire  !  fire  0th  layer  learn 
tran  output  e=0   !    fire  0th  layer  recall 
set  next  layer  learn  &  recall 
at  output  layer  ? 
loop  till  done 


Transfer  control  vector  to  userio  and  get  desired  output 


L  saRisa 

lset 

in, +2 

L  saR 
L   Risa 

io 
io 

Irnrslt 
write 

L  saRisa 

lset 

in,  +3 

L_saR 
L    Risa 

io 
io 

Irnout 
rcltst 

!  set  control  layer  learn  and  recall 

!  sent  control  input   learn 

!  sent  control  input   recall 

!  set  output  layer   learn  and  recall 

!  get  output  layer  desired  learn 

!  get  output  layer  desired   recall 
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!  Compute  final  outputs  at  output  layer 


L_saR 

math 

sum 

lnoise | ce=e 

tran 

output 

e-=w 

L    Risa 

math 

sum 

lnoise | ce=e 

tran 

output 

e-=w 

L    Risa 

eos 

f ire | e*=ef | swap| f ire  ! 
swap    Irecall 


write  results  to  userio 


L_saR 
L   Risa 


10 
io 


lrnrslt 
write 


!  sent  output     learn 
!  sent  output    recall 


learn  cycle   back  propagate  error   (note  at  output  layer) 


L_saR math 

L_saR @lloop  math 

LsaR lset 

L_saR lcmp 

L_saR  bgt 

L   aRisa        trace 


i=e | e=ce         !  put  desire  value  in  sum  field 
ce=e | e*=f ' | backp | learn | f ire   !    bkp/learn  3rd 


cur, -1 
in 

@lloop 
0 


previous  layer 

at  input  layer? 

loop  till  done 

turn  off  any  trace  function 


Note,  when  viewing  an  output  node,  output  contains  the  network  result, 
sum  contains  the  desired  result,  and  ce  contains  the  error. 
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csv2 . 1 

!file  format  is  Control  Strategy  Version  2.1 


Source:  contstr2.nnc 

Executable:  neuralworks  professional  II 

Version:  2 

Date:  30  Aug  1991 

Author:  D.  J.  Bertrand 

Project:  Neural  Networks  in  Adaptive  Control 

Environment:  UNIX/SunOS/Neuralworks  Control  Strategy 

Path:  eileen: /f il669/home/Monika 

Description:  This  is  a  prototype  control  strategy  for  use  with 

!  SimoMonika. c,  the  USERIO  program. 

!  This  strategy  uses  a  proprietary  language  which  is  covered 

!  in  some  detail  in  the  Neuralworks  Professional  II  manual. 

!  This  program  is  a  continuity  to  contstral . nnc. 


For  cases  3,4  &  5  : 

After  Level  1  has  been  trained  with  contstral, 

Level  2  is  then  trained  with  this  control  strategy  using 

the  inputs  and  outputs  of  Level  1  as  references. 

For  cases  6  &  7  : 

Contstral  is  not  necessary,  since  both  Level  1  &  2  can 
be  emulated  simultaneously  with  contstra2. 

For  case  8  : 

No  training  takes  place.  Make  sure  LR  is  set 
to  zero  before  using  contstra2. 


! 

1MASK     label 

L_saRisa 

Li  aRisa 


op-code  operands 
trace    aux3 
cset    recall, 0 


comment 

!    set  trace  option  to  aux3 

!    recall  count 


lset 

in 

io 

lrnin 

io 

read 

lset 

cur,  1 

io 

lrnin 

io 

read 

Get  inputs   of  Level  1  (learn  and  recall) 


L_saRisa 

L_saR 

L Risa 

L_saRisa 
L_saR 

L Risa 

1 

; 

j 

L_saRisa 

L_saR 

L Risa 

L_saRisa 
L_saRisa 
L  saRisa 


set  feedback  layer  or  input 
get  feedback  vector  learn 
get  feedback  vector  recall 
set  command  layer 
get  command  vector  learn 
get  command  vector  recall 


Start  forward  pass  to  but  not  including  output  layer 


lset 
§loopl  math 
math 
lset 
lcmp 
bit 


in 
sum 
sum 
cur,  1 
in, +3 
§loopl 


lnoise 
rnoise 


!    set  feedback  layer  or  input 


tran 
tran 


output 
output 


e=0|fire  !fire  0th  layer  learn 
e=0  !  fire  0th  layer  recall 
set  next  layer   learn  &  recall 

at  output  layer  ? 

loop  till  done 


Transfer  control  vector  to  userio  and  get  desired  output 


L_saRisa 

L_saR 

L   Risa 


lset 

in, +2 

io 

lrnrslt 

io 

write 

set  control  layer  learn  and  recall 
sent  control  input    learn 
sent  control  input    recall 
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L  saRisa 

lset 

in,  +3 

L  saR 

io 

lrnout 

L    Risa 

io 

rcltst 

set  output  layer   learn  and  recall 
get  output  layer  desired  learn 
get  output  layer  desired   recall 


Compute  final  outputs  at  output  layer 


L_saR 

math 

L    Risa 

math 

L    Risa 

eos 

sum  I lnoise | ce=e 
sum  lnoise  ce=e 


tran 
tran 


output 
output 


e-=w 
e-=w 


f ire | e*=ef | swap| f ire  ! 
swap    Irecall 


write  results  to  userio 


L_saR 
L   Risa 


10 
io 


lrnrslt 
write 


!  sent  plant  output     learn 
!  sent  plant  output   recall 


learn  cycle   back  propagate  error   (located  at  output  layer) 


L_saR_ 
L_saR_ 
L_saR_ 
L_saR_ 
L  saR 


math 

?loop2  math 

lset 

lcmp 
bgt 


i=e|e=ce        !  put  desire  value  in  sum  field 
ce=e | e*=f ' | backp| learn | f ire   !    bkp/learn  3rd 


cur, -1 

in 

@loop2 


previous  layer 

at  input  layer? 

loop  till  done 


note  that  the  error  does  not  need  to  be  backpropagated  if  using  cases  2  &  3 
It  has  already  been  trained  using  estimatl . nnc. 


Get  inputs  of  Level  2  (learn  and  recall) 


L  saRisa 

lset 

in,  +4 

L_saR_ 

io 

lrnin 

L   Risa 

io 

read 

L  saRisa 

lset 

cur,  1 

L_saR 

io 

lrnin 

L    Risa 

io 

read 

set  feedback2  layer  or  input 
get  feedback2  vector  learn 
get  feedback2  vector  recall 
set  command2  layer 
get  command2  vector  learn 
get  command2  vector  recall 


Start  forward  pass  to  but  not  including  output2  layer 


L_saRisa 

L_saR 

L R  i  s  a 

L_saRisa 
L_saRisa 
L  saRisa 


lset 
@loop3  math 
math 
lset 
lcmp 
bit 


in, +4 

sum 
sum 
cur,  1 
in,  +7 
@loop3 


set  feedback2  layer  or  input 


lnoise 
rnoise 


tran 

tran 


output 
output 


e=0|fire  !fire  Oth  layer  learn 
e=0  !  fire  Oth  layer  recall 
set  next  layer   learn  &  recall 

at  output2  layer  ? 

loop  till  done 


Transfer  control2  vector  to  userio  and  get  desired  output2 


L_saRisa 
L_saR 

L Risa 

L_saRisa 
L_saR 
L   Risa 


Compute  final  outputs  at  output2  layer 


lset 

in,  +6 

io 

lrnrslt 

io 

write 

lset 

in, +7 

io 

lrnout 

io 

rcltst 

L_saR 

math 

sum 

lnoise 

ce=e 

tran 

output 

e-=w 

L   Risa 

math 

sum 

lnoise 

ce=e 

tran 

output 

e-=w 

L   Risa 

eos 

set  control2  layer  learn  and  recall 

sent  control2  input    learn 

sent  control2  input   recall 

set  output2  layer   learn  and  recall 

get  output2  layer  desired  learn 

get  output2  layer  desired  recall 


fire | e*=ef | swap| fire 
swap    ! recall 
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write  results  to  userio 


L_saR 

L    Risa 


10 
io 


lrnrslt 
write 


!  sent  output2  learn 
!  sent  output2  recall 


learn  cycle   back  propagate  error   (note  at  output2  layer) 


L_saR math 

L_saR @loop4  math 

L_saR lset 

L_saR lcmp 

L_saR bgt 

L  aRisa  trace 


i=e | e=ce         !  put  desire  value  in  sum  field 
ce=e | e*=f | backp | learn | f ire   !    bkp/learn  3rd 


cur, -1 
in, +4 
@loop4 
0 


previous  layer 

at  input2  layer? 

loop  till  done 

turn  off  any  trace  function 


Note,  when  viewing  an  output  node,  output  contains  the  network  result, 
sum  contains  the  desired  result,  and  ce  contains  the  error. 
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APPENDIX  C:  NEURALWORKS  PROFESSIONAL  II  HEADER  FILES 


/***************************** ********  *************************************** 

*  11  april  1991  * 

*  transfer30hp.txt    (Optimal  case  )  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 
****************************************** **********************************^ 

/*  Define  the  case  #  */ 

/define    c         1       /*  X-29,  30  states  closed-loop  conf .  */ 


/*  Define  the  variables  */ 

/*  Level  1  */ 

/define  ordl       30  /* 

#define  num_in     2  /* 

/define  reg_vecl  120  /* 

/define  num_feed  118  /* 

#define  num_comd  120  /* 

/define  num_cont  120  /* 

/define  num  out    2  /* 


order  of  the  X-29  closed-loop  conf.  */ 

number  of  inputs  to  the  X-29  closed-loop  conf.*/ 

regression  vector  =ord* (num_in+num_out)  */ 

feedback  layer  =reg_vec-num_in  */ 

command  layer  =  reg_vec  */ 

control  layer  =  reg_vec  */ 

output  layer  =  num_out  */ 


/*  Level  2 
/define  ord2 
/define  num_in2 
/define  reg_vec2 
/define  num_feed2 
/define  num_comd2 
/define  num_cont2 
/define  num  out2 


(  not  reguired  )   */ 

1  /*  order  of  the  X-29  inverse  closed-loop  conf.*/ 

1  /*  number  of  inputs  to  the  X-29  inverse  closed-loop*/ 

1  /*  regression  vector  =ord* (num_in+num_out)  */ 

1  /*  feedback2  layer  =  reg_vec-num_out  */ 

1  /*  command2  layer=  reg_vec  */ 

1  /*  control2  layer  =  reg_vec  */ 

1  /*  output2  layer  =  num_in  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 

static  double  alphal={ 1 . 0} ; 

static  double  alpha2={ 0 . 01 } ; 

static  double  alpha3  =  { 0 . 001 }  ; 

static  char  *input_name []={ "Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 

static  char  *state_name[ ]={ "Illegal  State" , "u (t) " , "alpha (t) " , 
"q(t)" ,  "theta(t)"}; 


/*  Numerator  coefficients  of  the  X-29  closed-loop  conf.  */ 
/*  Order  is  al-a30  &  ql-q30  for  the  indices  */ 

static  double  numl [2 ] [ 2] [ 30]= 

{     7.217941790123916e-03, 
4.136127382910360e-02, 
-4. 669768974859352 e- 01, 
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1.74 09 1537891 07 8 5e+00 
-3.860972079490637e+00 

5. 910026001863514 e+ 00 
■6.603  62  37  24  905617e+00 

5. 4 618 1519 17 3 552 5e+00 
•3. 2701 58987 5 14 2 3 6e+00 

1.27 6667 299 594 394e+00 
■1.52  0754  07  4  6008  87e-01 
■2.051159  0497  927  66e-01 

1.94 534 55561 352 8 5e-01 
■1.05600984 0779 120e-01 

4.30502  4  816802  3  05e-02 
■1.421564  4  2  5160682e-02 

3.  8904 658 137292 60e-03 
-8.753  878  57  64  99  303e-04 

1.567  504  9  67  62  3  089e-04 
■2. 1084 57 01508 2 09 3e-05 

1.92 54 1909592 38 4 Oe-06 
■9.276539501321390e-08 
■7.822692189116382e-10 

3. 6066584 558 3  0 14 5e-10 
-1.7  312824  3764  22  58e-ll 

2. 82883 02 23439 08 7e- 13 
■1.035513 24 54 0549 le-15 

3.084  62  54  7  537  6078e-17 

6. 087 6291104 63 293e-20 

2. 188724 96803 13 3 5e-3 3 

3. 0302790642 4 8020e-02 
-2. 17 6617 3 63 31 137 9e-01 

7.199418522  371559e-01 
•1.44 58874 6883 12 4 5e+00 

1.937  2  32  4  3  87  53  2  56e+00 
-1.74 4 01058 51 3984 7e+00 

9.04  619103  077  0956e-01 

7. 52 09838389 07 114e-02 
-6.  94 29 194 4 06558 2 8e-01 

8. 18010872889 161 le-01 
-6. 296351231172181 e-01 

3.  7152  3  4 3 66 137 60 le-01 
-1.779572331 14 57  8  5e-01 

7.11314  3215820728e-02 
-2. 4 033782 64 4 7654 le-02 

6. 879 198 166074 04 6e-03 
-1.656190902 5 141 4 9e-03 

3. 3 0264 4 12 02 2 4 97 le-04 
-5.3  32  055003518747e-05 

6.764  4  47617547078e-06 
-6. 496114 3 58 14 854 8e-07 

4. 502 381 161607 562e-08 
-2. 099 03 3 629 117 87 5e-09 

5. 7059 13 270502 097e-ll 
-4. 93 6196094 12 47 3 9e-13 
-1.4  6316803  52  58  393e-14 

3. 33992 13691 61 159e-16 
- 1.652969 29 5 184 519e-18 

4. 51 14 32 668 1577 3 9e-2  0 

1. 618497006367023 e- 31 

2.913303838345982e-03 
-1.8 59587 162 6274 63e-03 
-7.2  57  31974  4  5194  64e-02 
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3. 655964 4 13 53 4 32 le-01 
-9.6063  613  29  5797  27e-01 

1. 6938273224 8  8  687e+00 
•2. 1828393 35964 559e+00 

2. 128533975768278 e+00 
•1.58724 664 94 502 3 6e+00 

8. 98694 60323 16325e-01 
■3.7  3081062  54  63  050e-01 

9. 989694 9964 9 7 53 3e-02 
■4. 97 03 2 66972 64 04 9e-03 
■1. 160762 684 8 18817e-02 

7.783152  2  5917  7  3  62e-03 
■3. 2557528 58 64 3 68 5e-03 

1.04 54 05054 2 5509 3e-03 
■2. 68 3 4 53 4 25099 14 2e-04 

5.4  32  54  8  388124  316e-05 
-8.28569616814  8078e-06 

8. 77874861932324 8e-07 
-5. 4 989 66 4 08 3 4 04 3 6e-08 

1.04 763 54 899 68 68 7e-09 

9.124468  02  4653338e-ll 
-5. 97 56 19276 08 2 550e- 12 

1. 06987 1 02 2 603 52 3e- 13 
-3. 507 3 7 597 159 3 066e- 16 

1. 21144 0893663403e- 17 

2. 074 97 067 08994 9 6e-2  0 

1.4964 28514 2  4 892 le-3 3 

4. 94 3 90604 04 69 59 2e-02 
-2. 4 8665984 7 197 28 8e-01 

4. 6965274 05284 4 56e-01 
-1. 71038484346127 0e-01 
-1.08 653 4 62 32 5 168 0e+00 

2. 936298628985867 e+00 
-4. 3559533 5292 32 2 3e+00 

4.581740987760242e+00 
-3. 705662 4 4 28 2 5 54 2e+00 

2. 399924 940838602e+00 
-1.27  69  3  8  53  84  602  57e+00 

5.  68 19 69684 92 3 19 6e-01 
-2. 13789554 04 6509 3e-01 

6. 82 4 3 80985 1077 14 e-02 
- 1.83 661 502 6668 54 2e-02 

4. 094 699 08162513 le-03 
-7. 3272999 57 345171e-04 

9. 96615354 874 9 378e-05 
-9. 192 8700900608 62e-06 

3.638980355619663e-07 

3.83  14  0334  804  3  370e-08 
-8.162814  69914  03  38e-09 

7. 5143847871 62991e- 10 
-4.20190927  02  7  8  608e-ll 

1.4  279  3  6059062  508e-12 
-2.6892  02  64  6566666e-14 

2.  64 5984 17  4 551 3 3 6e-16 
-2. 49926694749652 le- 18 

1.6136839 12 162787e-20 

1.105945879965 57 7e- 31 

}; 
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/*  Denominator  coefficients  */ 


static  d 


3. 
-9. 

1, 
-2 

3, 
-2 

2 
-1 

8 
-4 

1 


-6.8 

2.2 
-6 

1 
-3 

5 
-7 

8 
-7 

5 
-2 

8 
-2 

2 
-1 

2 
-5 
-8 


ouble 
{  "8 
24185 
37476 
40944 
91932 
33425 
79853 
58162 
74535 
67590 
95124 
66251 
94463 
18004 
94736 
90902 
55808 
50501 
17915 
26982 
09227 
05441 
59001 
81854 
24422 
56068 
58391 
70784 
31469 
03828 


den 
.702 
0549 
6111 
5672 
8749 
5870 
5445 
9651 
3225 
2025 
6484 
0649 
2993 
6442 
0246 
3924 
6631 
1205 
2688 
1612 
9267 
4682 
8209 
2939 
8762 
7541 
0836 
8492 
0227 
5790 
} 


1[30 
5733 
7143 
3938 
4747 
6610 
2251 
3790 
2271 
1508 
3134 
9884 
9725 
0960 
3043 
5194 
8257 
1920 
9587 
4709 
8150 
4024 
2522 
3059 
9137 
9926 
8978 
8694 
5840 
7660 
8764 


]  = 

79180253e+00, 

4e+01, 

0e+01 

8e  +  02 

5e+02 

2e  +  02 

0e  +  02 

2e  +  02 

8e  +  02 

2e  +  01 

9e  +  01 

6e+01 

2e  +  00 

8e  +  00 

le-01 

6e-01 

3e-02 

4e-03 

4e-04 

0e-05 

8e-06 

2e-07 

2e-08 

0e-10 

9e-ll 

4e-13 

5e-15 

le-17 

le-21 

3e-38 


/*  Does  not  apply  for  the  case  1  */ 
static  double  num2 [ 1] [ 1] [1]=  {1.0}; 

static  double  den2 [ 1 ]  =  { 1 . 0}  ; 
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*  11  april  1991  * 

*  transfer30lim.txt    (Limited  case  )  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 
A*************************-**************************************************/ 

/*  Define  the  case  /  */ 

/define   c        2       /*  X-29,  30  states  closed-loop  conf.  (limited  case)*/ 


/*  Define  the  variables  */ 

/*  Level  1  */ 

/define  ordl      30  /* 

#define  num_in     2  /* 

/define  reg_vecl  120  /* 

/define  num_feed  118  /* 

/define  num_comd  120  /* 

/define  num_cont  120  /* 

/define  nura  out    2  /* 


order  of  the  X-29  closed-loop  conf.  */ 

number  of  inputs  to  the  X-29  closed-loop  conf.*/ 

regression  vector  =ord* (num_in+num_out)  */ 

feedback  layer  =reg_vec-num_in  */ 

command  layer  =  reg_vec  */ 

control  layer  =  reg_vec  */ 

output  layer  =  num_out  */ 


/*  Level  2 

/define  ord2 

/define  num_in2 

/define  reg_vec2 

/define  num_feed2 

/define  num_comd2 

/define  num_cont2 

/define  num  out2 


(  not  required  )   */ 

1  /*  order  of  the  X-29  inverse  closed-loop  conf.*/ 

1  /*  number  of  inputs  to  the  X-29  inverse  closed-loop*/ 

1  /*  regression  vector  =ord* (num_in+num_out)  */ 

1  /*  feedback2  layer  =  reg_vec-num_out  */ 

1  /*  command2  layer=  reg_vec  */ 

1  /*  control2  layer  =  reg_vec  */ 

1  /*  output2  layer  =  num_in  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 

static  double  alphal={ 1 . 0} ; 

static  double  alpha2  =  {0 . 01 }  ; 

static  double  alpha3={ 0 . 001 }  ; 

static  char  *input_name[ ]={"Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 


static  char  *state_name []={ "Illegal  State" , "u (t) ", "alpha (t) " , 
"q(t)M,  "theta(t) "} ; 


/*  Numerator  coefficients  of  the  X-29  closed-loop  conf.  */ 
/*  Order  is  al-a30  &  ql-q30  for  the  indices  */ 

static  double  numl [2 ] [2 ] [30]= 

{     2.844220109210482e-05, 
-4. 63 63 4 34 904 60604 e-05, 
-4.8163  37  07124  7290e-04, 
2.  54 19 653 52 1794 3 2e-03, 
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•6. 221344563186904 e- 03 
9. 7 008 3 69064 04 2 2 0e-03 

-1.056937401995128e-02 
8.  128  098  82  7  00094  0e-03 

-3.  97904 54 97 3 17 2 02 e-0 3 
4.550147278905570e-04 

1.  23324910282463 0e-03 
-1.384 40382704 6299e-03 

9. 04 002 4 8 002 7 08 8 5e-04 
■4. 324 7 398 3 984 4 93 8e-04 

1.61587199  414  7  2  55e-04 
-4.804  31674  4  344  561e-05 

1.12282482 51 17 164 e-05 
-1.943751086891377e-06 

2. 02 26294476 09 448e-07 

3.4  08  939495269658e-09 
-5. 7 04 02 07 84 8907 7 5e-09 

1.058  98  2  4  6713  3109e-09 
-9. 70026935049811 5e-ll 

3. 95499355 09 5595 5e-12 

1.5562 57 99703718 5e-14 
-6. 31 66555293 66 355e-15 

1.4  34  341976227709e-16 
-5.284811098416118e-19 

1.694663 132 378 100e-20 

2.  28 04 3 14 602 64 7 2 6e-2 6 
1.3 02 8 67 2542 58 544 e-03 

-7. 3828514 3  05063 2 le-03 

1.  13  3  24  3132  534  290e-02 

2.  624 4 3 618 4 0667 8 le-02 
-1.5987 54 5788152 60e-01 

3.  8 7 15270277 72 57 2 e-0 1 
-6.112169441003061e-01 

7. 10294849175852 5e-01 
-6. 4 2 017 9 00 12 6 12 04 e-0 1 

4.654773480224321e-01 
-2.75658  52813  893  34e-01 

1.3  4  59  004  53  7  00608e-01 
-5. 422 29 500 12 27 4 4 0e-02 

1.783262619678538e-02 
-4. 63 168 04 02 4 3 64 4 4 e-03 

8.617  02  9  016  3  689  60e-04 
-6.  9508 53 8 5005 17 8 6e-05 
-2.24701588  54  2  04  23e-05 

1.2054 64 699656489e-05 
-3.218  59007  7  39  6812e-06 

5.  9135390124 6397 le-07 
-7.84  4  5774  617  31442e-08 

7.4  218  3  4  51163  2  813e-09 
-4.8157  2  4  5609  3  8900e-10 

2.02059  4  2  898  012  37e-ll 

-5. 015798784 97 4 lOOe- 13 

6. 4 3 892 6 158 02 2 87 5e-15 

-4. 5954734 9128094 Oe-17 

5.502338148222649e-19 

1.714467588949488e-24 

3. 4 1477 14 00578 3 3 le-05 

-1.114  9  3  04  2  8  0877  4  6e-04 

-1.84 1134 24 5808007e-04 

1.8  54  687  4  59  513116e-03 
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■5. 58609287 134 004 3e-03 

1.064 962 4 7 6698 3 8 3e-02 
■1.4998  62  8108  06007e-02, 

1. 648927429573632 e-02, 
•1.4  3  613  81592  8  3  47  3e-02 

9.8  663  968109  3  4  93  06-03, 
-5.2  582  03  3  78  502  913e-03 

2.0928  212  91967  084e-03 
■5.5653  6117  24  4  3772e-041 

4.8  0782  558  5118053e-05, 

4.  06627 1012703 7 37e-05( 
-2.  7 194 19553 09884 5e-05, 

1.03 3 1563 624 3 994 6e-05, 
-2. 95558 1602 3 4 854 5e-06, 

6.87053  8006159554e-07, 
- 1.3 169 394 15 15798 le-07 

2.02  62214  4  52  72  3  00e-08, 
-2. 3612 3 3864223 112e-09, 

1.92 1063 600537 676e- 10, 
-9.809951611347  3946-12, 

2. 653 27910387 62 79e-13, 
-2. 3 1923337288 07 82e- 15 
-1. 3 17 187 06 18962 19e- 17, 
-2. 4  07  012 53  58917  lie- 19, 
-4. 433880118258184 e-21 

2. 7 3 59 03 50502 2 4 65e-2 6 

1.59698 154 2963 505e-03 
-8.528373703732939e-03 

1.086196106746229e-02 

3.846897564267238e-02 
-1.976730935505202e-01 

4.554354535725906e-01 
-7.004  57  2  4103  51102e-01, 

8.039373  3  3  32  584  82e-01, 
-7.2  562729  31053  900e-01 

5.3  02  62192  41587  57e-01, 
-3.18914  6614  4  38982e-01, 

1.590513902 8 63 2 2 2e-01( 
-6.57  3  3  01084  8  674  67e-02, 

2 . 2  2  59  01012112  53  0e-02 
-5.988  9  5002  94  2  0792e-03 

1. 17784 2478515601e-03 
-1. 182446502 181467e- 04 
-2. 078456649373 67 2e-05, 

1.3 69232238 67 6 57 7e-05, 
-3.801953769720645e-06, 

7. 081334 3 52697 58 3e-07 
-9.4  37  638502  624414e-08 

8. 9 3 67 667 59 59 182 4e-09, 
-5. 7 94 7 05 377 00014 6e-10, 

2.428  4  64  2  999  36500e-ll, 
-6.021234  370560187e-13, 

7. 7244 62 4 74 10662 4e-l 5, 
-5. 51667195241885 5e-17, 

6. 59 5904 19 1 3 59 68 6e- 19 

2.056900519282188e-24 

}; 
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/*  Denominator  coefficients  */ 


static 

double  denl[30]= 

{   -1.135087146556161e+01, 

6 

09  3  2  63  24  9866681e+01, 

-2 

061911065822222e+02, 

4 

9480351327317 52e+02, 

-8 

98  392  372  54  8  34  06e+02, 

1 

28608968 3 0003 55e+03, 

-1 

4  9  374  4  79  37062  65e+03, 

1 

4374213 69 904793 e+ 03, 

-1 

1 64 29688962 08 3 4e+03, 

8 

034  3  8  06067  87  02  5e+02, 

-4 

7  665217867 13293e+02, 

2 

4  4  72  3  894  4  3  29  588e+02, 

-1 

09208644 22 02805e+02, 

4 

244916189022602e+01, 

-1 

4  37  006104  6777  57e+01, 

4 

22  59  052  64  8  68  55  3e+00, 

-1 

0  7  39317  22819  647e+00, 

2 

3  3  88  84  06580714  7e-01, 

-4 

313 167 04 34 614 74 e-02, 

6 

624455192814090e-03, 

-8 

28662  8  88  4  99  056  5e-04, 

8 

.19 501002777 0559e-05, 

-6 

. 1603  7  3  94  2  002  916e-06, 

3 

. 34  541693  077  07  2  9e-07, 

-1 

.22792 168 148 6361e-08, 

2 

. 77  54  7  58018  3  08  7  9e-10, 

-3 

.4102 87 17 0188014 e- 12, 

2 

. 517  895554  215908e-14, 

-2 

.  74  2185292  507S3.le-16, 

1 

.2761074284207359-33 

}; 

/*  Does  not  apply  for  the  case  1  */ 
static  double  num2[l] [1] [1]=  {1.0}; 
static  double  den2 [ 1 ]  =  { 1 . 0}  ; 
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/A*************************************************************************** 

*  11  april  1991  * 

*  transferhplinv.txt    (Optimal  case  input  1)  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 

/*  Define  the  case  /  */ 

/define    c        3       /*  X-29  inverse  closed-loop  conf.  structure  */ 


/*  Define  the  variables  */ 

/*  Level  1  */ 
/define  ordl 
/define  num_in 
/define  reg_vecl 
/define  num_feed 
/define  num_comd 
/define  num_cont 
/define  num  out 


30 

/* 

1 

/* 

90 

/* 

89 

/* 

90 

/* 

90 

/* 

2 

/* 

order  of  the  X-29  closed-loop  conf.  */ 

number  of  inputs  to  the  X-29  closed-loop  conf.*/ 

regression  vector  =ord* (num_in+num_out)  */ 

feedback  layer  =reg_vec-num_in  */ 

command  layer  =  reg_vec  */ 

control  layer  =  reg_vec  */ 

output  layer  =  num_out  */ 


/*  Level  2  */ 

/define  ord2  30 

/define  num_in2  2 

/define  reg_vec2  90 

/define  num_feed2  88 

/define  num_comd2  90 

/define  num_cont2  90 

/define  num  out2  1 


/*  order  of  the  X-29  inverse  closed-loop  conf.*/ 

/*  number  of  inputs  to  the  X-29  inverse  closed-loop*/ 

/*  regression  vector  =ord* (num_in+num_out)  */ 

/*  feedbacks  layer  =  reg_vec-num_out  */ 

/*  command2  layer=  reg_vec  */ 

/*  control2  layer  =  reg  vec  */ 

/*  output2  layer  =  num  In  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 

static  double  alphal={ 1 . 0} ; 

static  double  alpha2={ 0 . 01 } ; 

static  double  alpha3={0 . 001} ; 

static  char  *input_name []={ "Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 


static  char  *state_name[ ]={"Illegal  State" , "u (t) ", "alpha (t) ", 
•'q(t)",  "theta(t)"}; 


/*  Numerator  coefficients  of  the  X-29  closed-loop  conf 
/*  Order  is  al-a30  &  ql-q30  for  the  indices  */ 

static  double  numl[ 1] [2] [30]= 

{     7.217941790123916e-03, 

4.13  6127  3829103  60e-02, 

-4. 6697 68974859 3 52e-01, 

1.7  4  09153  7891078  5e+00, 

-3. 86 0972079490637 e  +  00, 
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91002 
60362 
46181 
27015 
27666 
52075 
05115 
94534 
05600 
30502 
42156 
89046 
75387 
56750 
10845 
92541 
27653 
82269 
60665 
73128 
82883 
03551 
08462 
08762 
18872 
03027 
17661 
19941 
44588 
93723 
74401 
04619 
52098 
94291 
18010 
29635 
71523 
77957 
11314 
40337 
87919 
65619 
30264 
33205 
76444 
49611 
50238 
09903 
70591 
93619 
46316 
33992 
65296 
51143 
61849 

}; 


6001863 
3724905 
5191735 
8987514 
7299594 
4074600 
9049792 
5556135 
9840779 
4816802 
4425160 
5813729 
8576499 
4967623 
7015082 
9095923 
9501321 
2189116 
8455830 
2437642 
0223439 
3245405 
5475376 
9110463 
4968031 
9064248 
7363311 
8522371 
7468831 
2438753 
0585139 
1030770 
3838907 
94^0655 
8728891 
1231172 
4366137 
2331145 
3215820 
8264476 
8166074 
0902514 
4120224 
5003518 
7617547 
4358148 
1161607 
3629117 
3270502 
6094124 
8035258 
1369161 
9295184 
2668157 
7006367 


514e+00 
617e+00 
525e+00 
236e+00 
394e+00 
887e-01 
766e-01 
285e-01 
120e-01 
305e-02 
682e-02 
260e-03 
303e-04 
089e-04 
093e-05 
840e-06 
390e-08 
382e-10 
145e-10 
258e-ll 
087G-13 
491e-15 
078e-17 
293e-20 
335e-33 
020e-02 
379e-01 
559e-01 
245e+00 
256G+00 
847e+00 
956e-01 
114e-02 
828e-01 
611e-01 
181e-01 
601e-01 
785e-01 
728e-02 
541e-02 
046G-03 
149e-03 
971G-04 
747e-05 
078e-06 
548e-07 
562e-08 
875e-09 
097e-ll 
739e-13 
393e-14 
159e-16 
519e-18 
739e-20 
023e-31 


161 


/*  Denominator  coefficients  */ 
static  double  denl[30]= 


{   -8.702573379180253e+00, 

3 

624185054971434 e+ 01, 

9 

6374766111393 8 0e+01, 

1 

84 094 4 5672474 78e+02, 

2 

6919  3  2874  966105e+02, 

3 

13  34  2  5587  02  2  512e+02, 

2 

97  98  53  54  4  53  7  9  00e+02, 

2 

358162965122712e+02, 

1 

574535322515088 e+02, 

8 

967590202 53 134 2e+01, 

4 

39512  4  64  8  4  9884  9e+01, 

1 

8662  51064  997  2  56e+01, 

6 

894  4  63  2  99  3  09602e+00, 

2 

2180046442304 3 8e+00, 

6 

194  7  3  602  4  651941e-01, 

1 

490902392482576e-01, 

3 

055808 6631 192 03e-02, 

5 

250501120595874e-03, 

7 

4179152  6884  709  4e-04, 

8 

426982161281500e-05, 

7 

509  22792  67  40248e-06, 

5 

105441468225222e-07, 

2 

5590018  2  09  3  0592e-08, 

8 

98185429399137 0e-10, 

2 

. 024  4  22876299269e-ll, 

2 

55  6068  7  5418  978  4e-13, 

1 

858391083686945e-15, 

2 

.07 07848492 58 401e-17, 

5 

2  314  6902  277  6601e-21, 

8 

,203828579087643e-38 

}; 

/*  Does  not  apply  for  the  inverse  plant  */ 
static  double  num2 [2 ] [ 1] [ 30]=  {1.0}; 
static  double  den2 [ 30]={ 1 . 0} ; 
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*  6  Sept  1991  * 

*  transferA4inv.txt  * 

*  Header  file  for  transfer  function  variables                            * 

*  Sampling  time  0.1  sec  * 

*  Capt  D.  Bertrand  * 
ft***************************************************************************/ 

/*  Define  the  case  /  */ 

/define    c        4       /*  A4  inverse  plant  structure  */ 


/*  Define  the  variables  */ 


/*  Level  1  */ 

/define  ordl  4 

/define  num_in  1 

/define  reg_vecl  20 

/define  num_feed  19 

/define  num_comd  2  0 

/define  num_cont  20 

/define  num_out  4 

/*  Level  2  */ 

/define  ord2  4 

/define  num_in2  4 

/define  reg_vec2  20 

/define  num_feed2  16 

/define  num_comd2  20 

/define  num_cont2  20 

/define  num  out2  1 


/* 
/* 

/* 
/* 
/* 
/* 
/* 


order  of  the  A4  plant  */ 

number  of  inputs  to  the  A4  plant  */ 

regression  vector  =ord* (num_in+num_out)  */ 

feedback  layer  =reg_vec-num_in  */ 

command  layer  =  reg_vec  */ 

control  layer  =  reg_vec  */ 

output  layer  =  num  out  */ 


/*  order  of  the  A4  inverse  plant  */ 

/*  number  of  inputs  to  the  A4  inverse  plant  */ 

/*  regression  vector  =ord* (num_in+num_out)  */ 

/*  feedback2  layer  =  reg_vec-num_out  */ 

/*  command2  layer=  reg_vec  */ 

/*  control2  layer  =  reg  vec  */ 

/*  output2  layer  =  num_In  */ 


/*  Declarations  */ 

static  double  ts={0.1}; 

static  double  alphal={ 1 . 0} ; 

static  double  alpha2={ 1 . 0} ; 

static  double  alpha3={0 . 001} ; 


static  char  *input_name[ ]={"Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 

static  char  *state_name []={ "Illegal  State" , "u (t) ", "alpha (t) " , 
•'q(t)",  "theta(t)"}; 


/*  Numerator  coefficients  for  the  A4  plant*/ 

/*  Order  is  ul-u4,  al-a4,  ql-q4  &  tl-t4  for  the  indices  */ 

static  double  numl [1] [4 ] [4 ]= 
{ 
2.713  0682100917  62e-05r 
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7.724759756833066e-05, 
-7.0557  911008  96158e-05, 
-2. 25793744 1507707e-05, 
-3. 4 6 1928 65 12 664 4 4 e-02, 

4. 502 2 3 58 17 67907 9e-02, 

1.3  715112  59671188e-02, 
-2.412  412  2  58  081098e-02, 
-1.986449763497378e-01, 

5.  8 0024 7 578 3 29 63 4e-01, 
-5. 64 13 669084 2774 le-01, 

1.82  7  56909  3  59  54  84e-01, 
-7.7  051804  3  74  52  608e-03, 

7.478124  872434933e-03, 

6. 964 0104 11 1017 2 9e-03, 
-6. 73862 59 84288427 e-03 

}; 

/*  Denominator  coefficients  for  the  A4  plant  */ 

static  double  denl[4]= 

{ 
-3. 694 92 3 64 3 8 54 8 2 2e+00, 
5. 180217  3  04  7  54  8  2  8e+00, 
-3.2  7  54  9  97  3  564  82  01e+00, 
7.90214  8612567799e-01 

}; 


/*  Does  not  apply  for  the  inverse  plant  */ 
static  double  num2 [4 ] [ 1] [4 ]=  {0.0}; 
static  double  den2 [ 4 ]={0 . 0} ; 
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/A*************************************************************************** 

*  28  July  1991  * 

*  transferl4inv.txt  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 

*  * 
a***************************************************************************, 

/*  Define  the  case  /  */ 

/define    c        5       /*  X-29  Inverse  plant  structure  */ 


/*  Define  the  variables  */ 


/*  Level  1  */ 
/define  ordl 
/define  num_in 
/define  reg_vecl 
/define  num_feed 
/define  num_comd 
/define  num_cont 
/define  num  out 


/*  Level  2  */ 

/define  ord2 

/define  num_in2 

/define  reg_vec2 

/define  num_feed2  40 

/define  num_comd2  42 

/define  num_cont2  42 

/define  num  out2 


14 

/* 

1 

/* 

42 

/* 

41 

/* 

42 

/* 

42 

/* 

2 

/* 

14 

/* 

2 

/* 

42 

/* 

40 

/* 

42 

/* 

42 

/* 

1 

/* 

order  of  the  X-29  Plant  */ 

number  of  inputs  to  the  X-29  Plant  */ 

regression  vector  =ordl*(num  in+num_out)  */ 

feedback  layer  =reg_vec-num_Tn  */ 

command  layer  =  reg_vec  */ 

control  layer  =  reg_vec  */ 

output  layer  =  num_out  */ 


order  of  the  X-29  inverse  plant  */ 
number  of  inputs  to  the  inverse  plant  */ 
regression  vector  =ord2* (num_in+num_out)  */ 
feedback2  layer  =  reg_vec-num_out  */ 
command2  layer=  reg_vec  */ 
control2  layer  =  reg  vec  */ 
output2  layer  =  num  Tn  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 

static  double  alphal  =  { 1. 0}  ; 

static  double  alpha2  =  {0. 01}  ; 

static  double  alpha3={0 . 001} ; 


static  char  *input_name[ ]={ "Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 

static  char  *state_name[ ]={"Illegal  State" , "alpha (t) " , 
"q(t)"}; 


/*  Numerator  coefficients  for  the  X-29  plant  */ 


static  double  numl [ 1] [2 ] [ 14  ]  = 

{    -4.056931727527413e-04, 
8.64  098  58  012  3  59  56e-04, 
-9. 64 53747784 153 17e-04, 
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7.6687  32134167  300e-04 , 

-3. 35520332452432 5e-04, 

2. 0029886001 1383 le-05, 

4.423899844696599e-05, 

-2.134  656278755809e-05, 

4.  20657 3 55632 188 3e-06, 
-2.414898471374619e-07, 

3.  9 3 554 158 6 3 7903 8e-09, 

-1. 296789423146734 e-09, 

6.012915966444080G-11, 

6.13  9928164  0967  63e-13, 

-1.4  688  3  68  679  32  3  99e-02, 

5.  067 23904467 04 8 Oe-02, 
-8. 18546328692164 6e-02, 

8.351205855023736e-02, 
-5. 8 569 19 3 127 82 694 e-02, 

2. 92792946770366 Oe-02, 
-1.082648765944 08 3e-02, 

2.9508  04  3993  05770e-03, 
-5. 601566387 11 1508e-04, 

6. 63 19 582 14 7 38 6 3 Oe-05, 
-2. 0503 3774889 524 Oe-06, 
-1. 17 59 2085541436 5e-07, 

4. 28664473364284 9e-09, 

6. 95398 5652 098 4 97e- 11 

}; 


/*  Denominator  coefficients  for  the  plant  */ 

static  double  denl[14]= 

{  -4 .729739487034623e+00, 

9.75658  3  6164  2  0810e+00, 
-1.169  64  503117  2  698e+01, 

9. 1799  64  64  72  2  8  64  9e+00, 
-5.025697420203761e+00, 

1.9789 13 68 3 674 68 6e+00, 
-5.630838727994958e-01, 

1.1374 807687247 02e-01, 
-1.554  2  52  09  52154  2  3e-02, 

1.300296942834 3 50e-03, 
-5.7  37414  05314  4  7  69e-05, 

1.0554  38679886130e-06, 
-4.92  4  500562  37  3  306e-09, 

1. 114762000808644 e- 10 

}; 


/*  Does  not  apply  for  the  inverse  plant  */ 
static  double  num2 [2] [ 1] [14 ]=  {1.0}; 
static  double  den2 [ 14 ]={ 1 . 0} ; 
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/A*************************************************************************** 

*  28  July  1991  * 

*  transferl614hp.txt        OPTIMAL  CASE  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 

*  * 

/*  Define  the  case  #  */ 

/define    c        6       /*  controller  and  plant  in  series  (optimal  case)  */ 


/*  Define  the  variables  */ 


/*  Level  1  */ 

/define  ordl  16 

/define  num_in  2 

/define  reg_vecl  64 

/define  num_feed  62 

/define  num_comd  64 

/define  num_cont  64 

/define  num  out  2 


/*  order  of  the  controller  */ 

/*  number  of  inputs  to  the  controller  */ 

/*  regression  vector  =ordl*(num  in+num_out)  */ 

feedback  layer  =reg_vec-num_Tn  */ 

command  layer  =  reg_vec  */ 

control  layer  =  reg_vec  */ 

output  layer  =  num_out  */ 


/* 
/* 
/* 
/* 


/*  Level  2  */ 

/define  ord2  14  /* 

/define  num_in2  2  /* 

/define  reg_vec2  56  /* 

/define  num_feed2  54  /* 

/define  num_comd2  56  /* 

/define  num_cont2  56  /* 

/define  num  out2  2  /* 


order  of  the  plant  */ 

number  of  inputs  to  the  plant  */ 

regression  vector  =ord2* (num_in+num_out)  */ 

feedback2  layer  =  reg_vec-num_out  */ 

command2  layer=  reg_vec  */ 

control2  layer  =  reg_vec  */ 

output2  layer  =  num_in  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 

static  double  alphal  =  { 1 . 0}  ; 

static  double  alpha2={ 1 . 0}  ; 

static  double  alpha3  =  { 0 . 001 }  ; 


static  char  *input_name []={ "Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 

static  char  *state_name[ ]={"Illegal  State" , "alpha (t) " ,   ■ 
"q(t)"}; 


/*  Numerator  coefficients  for  the  controller  */ 


static  double  numl [ 2 ] [ 2 ] [ 16 ]= 

{   -9.859880629593550e+01, 
4.651873138146647e+02, 
-1.05188 2 1057 3 088 le+03, 
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1.519 15493 604 44 2 5e+03 
•1.5579657 38284 664e+03 

1.21104  2  88  7  906508e+03 
•7.  4967 0954 9  9 54 8  2 8 e  +  02 

3.  7449737 3664 3 639e  +  02 
■1.478 54 1553785084 e+02 

4. 4664 3415647 02 94 e+ 01 
■1.00308 15222 4 4 19 le+01 

1.620404514735607e+00 
-1.74  2  79857  2  922  879e-01 

9.  72457544 29 109  2  8e-03 
-2. 03554 707 117 04 3 le-04 

8.  74 538807 373623 5e-13 
-4.3  88188  3  2  6607  877e+01 
-4. 6161772344 68056e+01 

6.39211114  568  2  509e+02 
-1.3974 4 8977 654 54 2e+03 

1.523867810494335e+03 
-9. 97962057 50514 04 e+02 

4.152  396606507909e+02 
-1.06 1478 517 03 6687e+02 

1.2695989 03 99964 7e+01 

1.194080535740361e+00 
-7.05554  955818  64  06e-01 

1.05628 361670384 9e-01 
-6.3244  66886079779e-03 

7. 09 64 63 3777 0584 7e-05 

3.281163  82  64  3  3  534e-06 

3.82  5564  62  5565415e-ll 

3.792  3  62  2  3  02  68161e+01 
-1.803 2 181874 44 186e+02 

3. 8099 3 54 0587 478 3e+02 
-4. 826993636192602 e+02 

4. 09 164 19 929 3 2 67 5e+02 
-2.3  34  44  6181168790e+02 

7. 988 6658 878 68 3 3 8e+01 
-7. 028 0018 653 07 54 4e+00 
-8.303847629806290e+00 

5.212  74  07  207  61116e+00 
-1.6978 068 02 24 9656e+00 

3.60372  3  2  94  285617e-01 
-4. 87 3 19340532758 le-02 

3. 1152 3998 6192 2 53e-03 
-7. 052 2 4 88 7 02 3 9 58 3e-05 

5.97  5861393289898e-13 
-2.24  4  3004  33086851e+01 

6.381138411559  539e+01 
-1. 296062641440044 e+01 
-1.7  3  22  617  2  2  8898  01e+02 

3.2  0184  4  27  503  0160e+02 
-2.8774  8  664  52  3  84  89e+02 

1.55397 08 089 197 18e+02 
-5.26  3  63  2  8  04  841900e+01 

1.0524  24851243618e+01 
-8. 0522 2 968 18 598 2 6e-01 
-1.294834 16832254 8e-01 

3.4  91001117  314  4  70e-02 
-2.62164  884  59012  27e-03 

4.369675047097478e-05 

1.084  7  03  68  0918890e-06 
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2. 614 0685535 57 722e- 11 

}; 

/*  Denominator  coefficients  for  the  controller  */ 


ic 

double  denl[16]= 

{   -4.134112763067415e+00, 

7 

952  03  653  53  4  32  8  5e+00, 

-9 

67922 24 66663 568e+00, 

8 

264  7  5500413  97  51e+00, 

-5 

1564  72  050247617e+00, 

2 

4 66202 5739161 16e+00, 

-9 

526651742543444e-01, 

3 

04  3  80417219103  5e-01, 

-7 

8094 502734 38016e-02, 

1 

507657409431068e-02, 

-2 

062878392003 597e-03, 

1 

8782  87  4  4 4  794 598e-04, 

-9 

2  672116203  6  53  8  9e-06, 

1 

77 686187 165154 3e-07, 

-4 

692902 5094 27273e-ll, 

-3 

103818469371239e-28 

}; 

/*  Numerator  coefficients  for  the  plant  */ 


sta 

tic 

double  num2 [ 2 ] [2 

[14]  = 

\ 

-3.58  52  63  08  064  0999e-05, 

-2 

777807450549119e- 

-05, 

4 

539524991091781e- 

-04, 

-5 

958420322347280e- 

-04, 

2 

664995123886627e- 

-04, 

-5 

610107617126658e- 

-06, 

-4 

188469924792937e- 

-05, 

1 

857095302063017e- 

-05, 

-3 

454000472385976e- 

-06, 

2 

192568109666768e- 

-07, 

3 

819556833218761e- 

-09, 

-4 

268854429590967e- 

-10, 

-2 

655110714860240e- 

"13, 

-5 

118954168088873e- 

-14, 

-7 

513347186476338e- 

-04, 

8 

561991155699999e- 

-03, 

-1 

277978855932282e- 

-02, 

1 

181476279265681e- 

-03, 

8 

878987005693340e- 

-03, 

-7 

486010702827839e- 

-03, 

2 

988938381587536e- 

-03, 

-6 

418478904496455e- 

-04, 

5 

742794875096026e- 

-05, 

1 

381940029905864e- 

-06, 

-4 

.971836625593487e- 

-07, 

1 

801323508010827e- 

-08, 

-2 

.814170373926085e- 

-11, 

2 

.083960044277704e- 

-12, 

-4 

.056931727527413e- 

-04, 

8 

.640985801235956e- 

-04, 

-9 

.645374778415317e- 

-04  , 

7 

.668732134167300e 

-04, 
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3. 

355203324524325e- 

■04, 

2. 

002988600113831e- 

■05, 

4  . 

423899844696599e- 

■05, 

2. 

134656278755809e- 

■05, 

4  . 

206573556321883e- 

•06, 

2. 

414898471374619e- 

"07, 

3. 

935541586379038e- 

-09, 

1. 

296789423146734e- 

-09, 

6. 

012915966444080e- 

-11, 

6, 

,139928164096763e- 

"13, 

1, 

.468836867932399e- 

-02, 

5, 

,067239044670480e- 

-02, 

8, 

,185463286921646e- 

-02, 

8, 

,351205855023736e- 

-02, 

5. 

,856919312782694e- 

-02, 

2 

,927929467703660e- 

-02, 

1 

,082648765944083e- 

-02, 

2 

,950804399305770e- 

-03, 

•5 

,601566387111508e- 

-04, 

6 

.631958214738630e- 

-05, 

■2 

.050337748895240e- 

-06, 

1 

■175920855414365e- 

-07, 

4 

.286644733642849e- 

-09, 

6 

.953985652098497e- 

}; 

-11 

/*  Denominator  coefficients  for  the  plant  */ 


static 

double  den2[14]= 

{  -4 .729739487034623e+00, 

9. 

,  7  5658  3  6164  2  0810e  +  00, 

-1, 

.  16964 503 117  2 698e  +  01, 

9, 

,  17 99 64 64 72 2  8  64 9e  + 00, 

-5. 

,025697420203761e+00, 

1. 

,97891368367468 6e +00, 

-5. 

,63  08  38727994958e-01, 

1, 

,  1374 8 07 687 24 7  02 e-01, 

-1. 

.  554  2  52  0952154  2  3e-02, 

1. 

.30029694 2834 3 50e-03, 

-5, 

,737414053144769e-05, 

1, 

.05543867988613 Oe-06, 

-4 

.924 500562373 306e-09, 

1 

.  114  7  62  0008  0864  4e-10 

}; 
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*  28  July  1991  * 

*  transferl6141im.txt  LIMITED  CASE                                 * 

*  Header  file  for  transfer  function  variables                            * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 

*  * 
a***************************************************************************/ 

/*  Define  the  case  /  */ 

/define    c        1                I  *  controller  and  plant  in  series  (limited  case)  */ 


/*  Define  the  variables  */ 


/*  Level  1  */ 

/define  ordl  16 

/define  num_in  2 

/define  reg_vecl  64 

/define  num_feed  62 

/define  num_comd  64 

/define  num_cont  64 

/define  num  out  2 


/*  order  of  the  controller  */ 

/*  number  of  inputs  to  the  controller  */ 

/*  regression  vector  =ordl*(num  in+num_out)  */ 

/*  feedback  layer  =reg_vec-num_Tn  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  num_out  */ 


/*  Level  2*1 

/define  ord2  14  /* 

/define  num_in2  2  /* 

/define  reg_vec2  56  /* 

/define  num_feed2  54  /* 

/define  num_comd2  56  /* 

/define  num_cont2  56  /* 

/define  num  out2  2  /* 


order  of  the  plant  */ 

number  of  inputs  to  the  plant  */ 

regression  vector  =ord2* (num_in+num_out)  */ 

feedback2  layer  =  reg_vec-num_out  */ 

command2  layer=  reg_vec  */ 

control2  layer  =  reg  vec  */ 

output2  layer  =  num_In  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 

static  double  alphal  =  { 1 . 0}  ; 

static  double  alpha2={ 1 . 0} ; 

static  double  alpha3={0 . 001}  ; 

static  char  *input_name []={ "Illegal  Input", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1) "," (input  2)"}; 

static  char  *state_name[ ]={ "Illegal  State" , "alpha (t) " , 
"q(t)"}; 


/*  Numerator  coefficients  for  the  controller  */ 


static  double  numl [ 2 ] [2] [ 16]= 

{   -2.479711140348080e-01, 
1.3885462 04 67 2132e+00, 
-3.54  677  24  05083  3  24e+00, 
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56557 
09588 
98544 
14659 
55467 
05991 
86404 
43707 
79535 
14457 
44242 
20537 
02604 
61365 
18006 
15854 
99724 
97947 
14991 
11660 
08359 
45975 
94781 
18180 
27096 
46461 
31284 
00613 
68135 
53653 
56466 
36035 
30303 
25232 
69522 
05265 
87718 
75462 
89139 
05022 
33800 
54569 
53772 
20232 
83017 
48330 
78342 
81954 
33322 
56627 
51274 
44174 
71333 
50384 
67435 
04357 
44615 
96049 
57597 
83564 


8428 
2090 
7353 
9111 
5660 
0645 
7652 
4509 
4757 
1099 
9543 
6035 
8729 
8394 
9353 
7648 
5892 
4879 
6375 
9373 
0416 
9671 
7097 
1294 
9302 
5832 
7660 
5234 
3315 
6100 
0964 
0547 
1625 
4911 
1168 
9667 
2667 
5922 
0637 
5911 
9693 
2523 
4466 
7264 
6852 
9500 
8912 
6231 
7159 
0736 
1534 
2008 
5098 
2147 
0820 
1874 
5271 
1892 
2011 
0847 


0167 
0954 
4673 
3017 
7724 
9555 
4596 
2195 
0269 
4212 
0137 
0606 
3601 
6409 
9174 
3223 
4404 
1527 
3880 
2793 
5427 
1031 
2507 
7945 
2696 
0961 
6535 
3439 
1036 
5274 
7900 
6537 
5803 
5736 
9850 
2845 
4140 
8665 
7200 
8855 
2894 
7681 
2115 
9793 
0174 
9924 
7518 
2038 
2901 
6734 
0949 
1684 
8250 
4336 
4411 
8775 
9701 
1874 
6591 
9502 


57e+00 
44e+00 
08e+00 
40e+00 
83e+00 
77e-01 
34e-01 
4  6e-02 
77e-03 
36e-04 
51e-05 
77e-06 
74e-10 
16e-01 
21e+00 
19e+00 
89e+00 
47e-01 
88e-02 
31e-01 
16e-02 
29e-03 
82e-04 
04e-04 
26e-05 
48e-05 
19e-06 
73e-07 
45e-08 
25e-01 
82e+00 
34e+00 
67e+00 
20e+00 
64e+00 
34e+00 
60e+00 
97e-01 
03e-01 
80e-02 
73e-03 
67e-04 
12e-05 
68e-07 
13e-10 
26e-01 
52e+00 
30e+00 
75e+00 
81e+00 
85e-01 
90e-01 
08e-01 
57e-01 
99e-02 
50e-02 
64e-04 
38e-05 
12e-05 
34e-07 
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2. 017 17 22 7201988 8e-08 

}; 

/*  Denominator  coefficients  for  the  controller  */ 


static 

double  denl[16]= 

{    -6. 625803214724185e+00, 

1 

987480946391011e+01, 

-3 

5981992  088  59  2  6  3e+01, 

4 

4  3  294  4  619799812e+01, 

-3 

9799 190392 5684 0e+01, 

2 

722951670474420e+01, 

-1 

4  6199114  0558815e+01, 

6 

.  2  67  9  215847  38  07  5e+00, 

-2 

16025568 172 3939e+00, 

5 

94  7  8  02  317  87  554  7e-01, 

-1 

274  873  020013756e-01, 

2 

017  52 103 194 1172e-02, 

-2 

12403 1340776859e-03, 

1 

171829283955842e-04, 

-2 

459886242548657e-06, 

1 

3  53  889  59  01687  05e-22, 

}; 

/*  Numerator  coefficients  for  the  plant  */ 


ic 

double  num2 [2] [2 

[14]  = 

. 

[    -3. 585263080640999e-05 

-2 

777807450549119e- 

-05, 

4 

539524991091781e- 

-04, 

-5 

958420322347280e- 

-04, 

2 

664995123886627e- 

-04, 

-5 

610107617126658e- 

-06, 

-4 

188469924792937e- 

-05, 

1 

857095302063017e- 

-05, 

-3 

454000472385976e- 

-06, 

2 

192568109666768e- 

-07, 

3 

819556833218761e- 

-09, 

-4 

268854429590967e- 

-10, 

-2 

655110714860240e- 

"13, 

-5 

118954168088873e- 

-14  , 

-7 

513347186476338e- 

-04  , 

8 

561991155699999e- 

-03, 

-1 

277978855932282e- 

-02, 

1 

181476279265681e- 

-03, 

8 

878987005693340e- 

-03, 

-7 

486010702827839e- 

"03, 

2 

988938381587536e- 

-03, 

-6 

418478904496455e- 

-04, 

5 

742794875096026e- 

-05, 

1 

381940029905864e- 

-06, 

-4 

971836625593487e- 

"07, 

1 

801323508010827e- 

-08, 

-2 

,814170373926085e- 

-llf 

2 

,083960044277704e- 

-12, 

-4 

,056931727527413e- 

-04, 

8 

,640985801235956e- 

-04, 

-9 

.645374778415317e- 

-04, 
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7.668732134167300e-04, 
-3.3  55203  3  24  524  325e-04, 

2.002988600113831e-05, 

4.423899844696599e-05, 
-2.134656278755809e-05, 

4. 206573 55632 188 3e-06, 
-2. 4 1489847 1374 619e-07, 

3.9  3  554158637  9038e-09, 
-1.296789423146734e-09, 

6.0129159664  4  4  080e-ll, 

6. 13 9928164 0967 63e-13, 
-1.4688 3 686793 2 399e-02, 

5. 0672 3904 4 67 04 8 0e-02, 
-8. 1854 632 8 692 164 6e-02, 

8. 3  512  058  5502  37  3  6e-02, 
-5. 8569 19 3 12782 694 e-02, 

2.  927 9294 67703 660e-02, 
-1.08264 87 6594 4 08 3e-02, 

2. 9 508 04 3 99 3 057 7 0e-03, 
-5. 601566 387  111 508e-04, 

6. 63 19 582 14 7 3863 Oe-05, 
-2. 0503 3774 8 89 52 4 0e-06, 
-1. 17 59208554 14 365e-07, 

4.  2866447 3364 284 9e-09, 

6.  9 5398 5652 0984 97e- 11 

}; 


/*  Denominator  coefficients  for  the  plant  */ 

static  double  den2[14]= 

{  -4.729739487034623e+00, 

9.7  5658  3  6164  2  0810e+00, 
-1.16964 5031 172 698e+01, 

9. 179964 64 7 2 28 64 9e  +  00, 
-5.  02 5697 4 2 02 03 7 6 le  +  00, 

1.97  8913  68  3  67  4  686e+00, 
-5.630838727994958e-01, 

1.13  74  8  07  6872  4702e-01, 
-1.554  2  52  09  52154  2  3e-02, 

1.3  0029694  2  8  34  3  50e-03, 
-5.737414053144769e-05, 

1.05 54 3 8 6798861 3 0e-06, 
-4. 924 500562 373306e-09, 

1. 1 14 7 62 0008 08 64 4 e- 10 

}; 
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APPENDIX  D:  MATLAB  M-FILES 


%  contdiscliml  .m 

%  input  files: .. .hinf lim.mat 

%  output  f iles: . . . tf liml/2 .mat,  contdiscliml/2/a/q.met ,  trueliml/2/a/q.mat 

%"THIS  M-FILE  CREATES   DISCRETE  &  CONTINUOUS  BODE  PLOTS  FOR  THE  PLANT 

I  STATE  REPRESENTATION  OF  Hinf  LIMITED  PERFORMANCE  X-29  model,  CASE  /2  . 

%  Altitude  =  30000  feet 

%  Mach#  =  .5 


The  A,B,C  and  D  matrices  are  first  balanced  to  measure  a  reasonable  condition 
number  for  the  A  matrix,  then  converted  from  a  continuous  to  a  discrete  state 
space  model  using  Ts=0.02  sec  as  the  sampling  time,  and  finally  converted  to 
a  transfer  function  form  using, 


H(z)=  C*inv(zI-A)*B=  Y(z)/U(z) 


(1) 


By  replacing  the  z-transform  with  the  1/q  backward  shift  operator,  the 
numerator  and  denominator  terms  of  that  transformation  may  be  used  to  obtain 
the  DARMA  model, 


A(q)y(t)  =  B(q)u(t) 
Reworking  equation  (2)  gives  [Ref.  7:pp.  71-72], 


y(t)  =  B(q)u(t)  -  (A(q)  -  l)y(t) 


(2) 


(3) 


Expanding  the  matrix  polynomials  and  rearranging  it  to  obtain  two  recursive 
equations  of  the  form  similar  to  equation  (3.8)  of  Chapter  III  gives, 

Yi(t)  =  SUMj[Bij*Uj(t-j)  -  SUMj[Aj*Yj(t-j)]   (4) 

where  SUM  indicates  a  summation  operation 
i    indicates  the  number  of  outputs 

j    indicates  the  number  of  past  input  and  output  measurements 
Aj   terms  are  the  denominator  coefficients 
Bij  terms  are  the  numerator  coefficients 

The  algorithm  referring  to  the  control  input  in  USERIO  of  the  case  request 
RQ_LEARNRSLT  of  Appendix  A,  is  represented  by  equation  (4).  Control  [j] 
specifies  the  first  30  elements  of  the  control  layer,  which  are  the  past  30 
inputs,  [Uj(t-j)],  whereas  control  [30*(i+l)+j]  specifies  the  second  and  the 
third  block  of  30  elements,  which  are  the  past  30  outputs,  [Yj(t-j)),  for 
each  of  the  two  ouput  elements. 

Finally,  the  coefficients  for  B(q)  and  A(q)-1  matrices  of  equation  (3) 
are  represented  in  the  Transfer. h  files  as  the  numerator  and  denominator 
coefficients  for  both  cases,  Optimal  and  Limited  performance. 


%  get  the  a,b,c  &  d  matrices 

load  hinflim.mat 

a=acgf ; 
b=bcgf ; 
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c=ccgf ; 
d=dcgf ; 

%   balance  a  ,b  and  c  matrices. 

[ab,bb,cb,g, t]=obalreal (a, b, c) ; 

%  compute  continuous  Bode 

disp('  calculating  continuous  Bode  please  wait') 

w=logspace (-3,2, 1024 ) ; 

[  mage, pha sec ]=bode (ab, bb, cb,d, 1 , w) ; 

mag=20*logl0 (mag) ; 

%  Compute  discrete  time  system 
t=.02;       %  SAMPLING  TIME 
[ad,bd]=c2d(ab,bb,t) ; 

%  Compute  transfer  function  for  the  two  inputs 

[numl ,denl ]=ss2tf (ad , bd, cb, d, 1) ; 
[num2 ,den2 )=ss2tf (ad, bd , cb,d, 2)  ; 


Isave  tfliml  numl  denl 
%save  tflim2  num2  den2 


%  Discrete  Bode  plot  calculations 

disp( ' ' ) 

disp('  calculating  discrete  Bode  Nyquist  50Hz    T=.02  ') 


[mag,phase]=dbode (ad,bd, cb,d, 1, w) ; 

log log(w, mage ( : , 1) , 50*w,mag( : , 1) ) 

title('X-29  Continuous  and  Discrete  Alpha  Frequency  Response') 

title ('  Optimal  case  -  input  1  ') 

xlabel( 'Altitude  =  30000  feet     frequency  (Hz)      Mach  =.5'), 

ylabel ( 'magnitude  ') 

text (0. 01 ,. 0001, 'continuous   _') 

text(. 01, .00001, 'discrete  ') 

meta  contdisclimla 
pause 


loglog(w,magc ( : ,2) , 50*w,mag ( : ,2) ) 

title ('X-29  Continuous  and  Discrete  Q   Frequency  Response  ') 

title ('  Optimal  case  -  input  2  ') 

xlabel( 'Altitude  =  30000  feet     frequency  (Hz)      Mach  =.5'), 

ylabel ( 'magnitude  ') 

text (0. 1, . 001 , 'continuous   _') 

text ( .1, .0003, 'discrete  ') 
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meta  contdisclimlq 


f=w; 

m=mag ( : , 1) ; 

Isave  truelimla  f  m 

m=mag  ( :  ,  2)  ; 

Isave   truelimlq    f   m 
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%  wgtm.m 

%  This  matlab  file  calculates  the  SVD  of  the  weight  matrices, 

%  which  are  composed  of  the  connections  weights  between  the 

%  two  hidden  layers.  The  first  hidden  layer  has  42  elements 

%  and  the  second  hidden  layer  has  been  tested  with  30,  21, 

%  12,  8  and  5  elements. 

%  The  input  . nnp  files  are  from  the  optimal  controller  network  1 

%  of  case  06   or  case6h2.nnd. 


load  c6h230.nnp 

load  c6h221.nnp 

load  c6h212.nnp 

load  c6h28.nnp 

load  c6h251.nnp 

load  c6h22.nnp 

[m,nl]=size (c6h230) ; 
[m,n2 ]=size (c6h221) ; 
[m,n3 ]=size (c6h212) ; 
[m,n4 ]=size(c6h28) ; 
[m,n5]=size (c6h251) ; 
[m,n6]=size (c6h22) ; 

tfl=c6h230( : , 3:nl) ; 
tf2=c6h221(: ,3:n2) ; 
tf3=c6h212 ( : ,3:n3) ; 
tf4=c6h28(: ,3:n4) ; 
tf5=c6h251( : ,3:n5) ; 
tf6=c6h22 (: ,3:n6) ; 


%  Load  the  .nnp  files. 


%  Obtain  the  size  of  each  matrix. 


%  Get  rid-off  the  first  two  elements. 


t=0: 100:9900; 


%  Time  vector. 


al=zeros( (nl-2)/30,30) 
a2=zeros( (n2-2) /21,21) 
a3=zeros( (n3-2) /12 , 12) 
a4=zeros ( (n4-2) /8 , 8) ; 
a 5= zeros ((n5-2)/5,5); 
a 6= zeros ( (n6-2) /2 , 2)  ; 


%  Divide  the  matrix  into  blocks  of  which 
%  the  number  of  columns  equals  the  number 
%  of  elements  in  the  second  hidden  layer. 


for 


i=l 

m 

al( 

)=tfl(i,:); 

sl( 

, i)=svd (al) 

a2( 

)=tf2(i,:); 

s2( 

, i)=svd (a2) 

a3( 

)=tf3(i,:); 

s3( 

,  i)=svd (a3) 

a4( 

)=tf4(i,:); 

s4( 

, i)=svd (a4) 

a5( 

)=tf5(i,:); 

s5( 

,  i)=svd (a5) 

a6( 

)=tf6(i,:); 

s6( 

, i) =svd(a6) 

%  Calculate  the  actual  SVD's. 


end, 


i=f ind (sl< . 6)  ; 
si (i)=zeros (i)  ; 
i=find(s2<.54)  ; 


%   Get   rid-off   the   insignificant  values. 
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s2 (i) =zeros (i) 
i=f ind(s3<.45) 
s3 ( i)=zeros (i) 
i=f ind(s4<.39) 
s4 ( i) =zeros ( i) 
i=f ind(s5<.35) 
s5 (i) =zeros (i) 
i=find(s6<.30) 
s6  (i)=zeros(i) 


axis([0  10000  0.1  6]) 

plot(t,sl' , '-') 

title ('SVD  plot  of  the  wgt 

xlabel ( 'Number  of  Epochs') 

ylabel('SVD') 

Beta  svd41 

pause 


plot(t,s2' , '-') 

title ('SVD  plot  of  the  wgt  matrix 

xlabel ( 'Number  of  Epochs') 

ylabel( 'SVD' ) 

meta  svd42 

pause 


matrix  (hidden  2-30  elements)') 


(hidden  2-21  elements)') 


plot(t,s3' , '-') 

title ('SVD  plot  of  the  wgt 

xlabel ( 'Number  of  Epochs') 

ylabel( 'SVD' ) 

meta  svd4  3 

pause 

plot(t,s5' , '-') 

title('SVD  plot  of  the  wgt 

xlabel ( 'Number  of  Epochs') 

ylabel('SVD') 

meta  svd44 

pause 


matrix  (hidden  2-12  elements)') 


matrix  (hidden  2-5  elements)') 


plot(t,s6' , '-') 

title ('SVD  plot  of  the  wgt  matrix 

xlabel ( 'Number  of  Epochs') 

ylabel('SVD') 

meta  svd45 

pause 


(hidden  2-2  elements)') 
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%  spcallim.m 

%  input  files:  ...  inputliml/2 .nnp,  plantliml/2 .nnp 

%  output  files: .. .specliml/2 .mat 

%  THIS  M-FILE  CREATES  THE  SPECTRUM  RETURNS  OF  CASE  #2  OF  BOTH  INPUTS 

%  WITH  A  5  ARRAYS  FUNCTION  P= [Pxx, Pyy , Pxy ,Txy , Cxy ]  WHERE  Txy  IS  THE 

%  COMPLEX  TRANSFER  FUNCTION  FROM  X  TO  Y.  P=SPECTRUM (X, Y,M)  WHERE  X=  INPUT 

%  VECTOR,  Y=OUTPUT  VECTOR,  AND  M=2048  PTS,  WHICH  DIVIDES  BOTH  VECTORS  INTO 

%  SECTIONS  OF  2048  POINTS  EACH. 

%  PERFORM  SPECTRAL  ANALYSES  ON  THE  TWO  SEQUENCES  X  AND  Y. 

load  input liml .nnp 

load  plantliml .nnp 

load  inputlim2 .nnp 

load  plantlim2 .nnp 

xl=inputliml (1:2049, 3) 
yl=plantliml (1:2049, 3) 
zl=plantliml (1:204  9, 4) 
x2= input lim2 (1:204  9,3) 
y2=plantlim2 (1:2049, 3) 
z2=plantlim2(l:204  9,4) 

clear  inputliml  pJantliml  inputlim2  plantlim2 

disp(l) 

Pal=spectrum(xl ,yl, 2048 , 1024)  ; 

disp(2) 

Pql=spectrum(xl, zl, 2048, 1024) ; 

disp(3) 

Pa2=spectrum(x2,y2,2  04  8, 1024) ; 

disp(4) 

Pq2=spectrum(x2, z2, 2048, 1024) ; 

save  specliml  Pal  Pql; 
save  speclim2  Pa2  Pq2 ; 
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%  splotsliml .m 

%  input  files:  . . . specliml/2 .mat ,  trueliml/2/a/q.mat 
%  output  files:...  TFliml/2/a/q.met 

%  THIS  M-FILE  COMPARES  THE  SYSTEM  AND  NETWORK  ALPHA  AND  Q  "FREQUENCY"  RESPONSES 
%  FOR  CASE  #2  (LIMITED  CASE)  WITH  RESPECT  TO  THE  TWO  INPUTS. 

load  specliml; 
load  speclim2; 

[n,m]  =  size (Pal)  ; 

Fs=100; 

f 1  =  (l:n-l) /n*Fs/2; 


load  truelimla; 

loglog(pi*f l,abs(Pal (2:n,4)),50*f,m) 

title ('Txy  -  Transfer  function  for  Alpha  (Limited  case  -input  1)') 

xlabel('   Altitude=  30,000  feet     frequency (hz)     Mach=  0.5   ') 

y label ('Magnitude' ) 

text (1 . 0, . 001 , 'True  system  ') 

text (1.0, .0005, '40k  cycles  _  _' ) 

meta  TFlimal 

pause 

load  truelimlq; 

loglog(pi*f l,abs(Pql (2:n,4)),50*f,m),  ... 

title ('Txy  -  Transfer  function  for  Q  (Limited  case  -input  1)') 

xlabel('   Altitude=  30,000  feet     frequency (hz)     Mach=  0.5   ') 

ylabel( 'Magnitude') 

text (0. 3 ,. 02, 'True  system  ') 

text(0.3, .008, '40k  cycles  _  _') 

meta  TFlimql 

pause 

load  truelim2a; 

loglog(pi*f 1 , abs (Pa2 (2 : n, 4 ) ) ,50*f ,m) 

title('Txy  -  Transfer  function  for  Alpha  (Limited  case  -input  2)') 

xlabel('   Altitude=  30,000  feet     frequency (hz)     Mach=  0.5   ') 

ylabel( 'Magnitude' ) 

text (1 .0, . 001, 'True  system  ') 

text(1.0, .0005, '40k  cycles  _  _' ) 

meta  TFlima2 

pause 

load  truelim2q; 

loglog(pi*f 1 , abs (Pq2 (2 : n, 4 ) ) ,50*f ,m) ,  ... 

title ('Txy  -  Transfer  function  for  Q  (Limited  case  -input  2)') 

xlabel('   Altitude=  30,000  feet     frequency (hz)     Mach=  0.5   ') 

ylabel( 'Magnitude' ) 

text (0. 3 , . 02 , 'True  system  ') 

text(0.3, .008, '40k  cycles  _  _') 

meta  TFlimq2 

pause 
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%  liml.m 

%  input  f iles: . . .hinf lim.mat ,  stepliml/2 .nnp 

%  ouput  f iles: ... liml/2/a/q. met 

%  THIS  M-FILE  COMPARES  THE  SYSTEM  AND  NETWORK  ALPHA  &  Q  "TIME"  RESPONSE  FOR 
%  CASE  #2  (LIMITED  CASE)  WITH  RESPECT  TO  THE  TWO  INPUTS. 

load  hinf lim.mat 
load  stepliml.nnp 
load  steplim2.nnp 
format  long  e 

wl=stepliml(l:251,3)  ; 
zl=stepliml(l:251,4)  ; 
v2=steplim2(l:251,3)  ; 
z2=steplim2 (1: 251, 4)  ; 

clear  stepliml  steplim2 

timel=[ 0: 0. 02: 5]  ;     %  for  the  network  response 

%  ul-  input  1  and  u2-  input  2. 

ul=[ones (1,101)  zeros (1, 3  00) ; zeros (1,401)]'; 
u2=[ zeros (1,401) ;ones (1,101)  zeros(l, 300) )' ; 

[yl]=lsim(acgf ,bcgf ,ccgf ,dcgf ,ul, timel) ; 
[y2]=lsim(acgf , bcgf , ccgf ,dcgf ,u2 , timel) ; 

plot ( timel, yl(: ,1) , timel, zl) 

title('X-29   DESIRED  AND  ACTUAL  ALPHA   RESPONSE  (limited  case  -input  1)') 

xlabel('TIME  -  SEC) 

ylabel( 'DEGREES') 

text(l. 75, .6, 'Desired  ') 

text( .5, .12, 'Actual  ') 

grid 

Imeta  limla 

pause 

plot (timel ,yl ( : , 2) , timel, wl) 

title  ('X-29   DESIRED  AND  ACTUAL  Q  RESPONSE ( limited  case  -input  1)') 

xlabel('TIME  -  SEC) 

ylabel( 'DEGREES' ) 

text(l. 75, .6, 'Desired  ') 

text ( .5, .12, 'Actual  ') 

grid 

Imeta  limlq 

pause 

plot (timel ,y2 ( : , 1) , timel, z2) 

title('X-29   DESIRED  AND  ACTUAL  ALPHA   RESPONSE  (limited  case  -input  2)') 

xlabel('TIME  -  SEC) 

ylabel(' DEGREES') 

text(l. 75, .6, 'Desired  ') 

text(.5, .12, 'Actual  ') 

grid 

%meta  lim2a 

pause 
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plot (timel ,  y2 ( : , 2) , timel , w2) 

title ('X-29   DESIRED  AND  ACTUAL  Q  RESPONSE ( limited  case  -input  2)') 

xlabel('TIME  -  SEC) 

ylabel( 'DEGREES') 

text(l. 75, .6, 'Desired  ') 

text (.5, .12, 'Actual  ') 

grid 

%meta  lim2q 

pause 
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APPENDIX  E:  TABLE  OF  CONFIGURATIONS  AND  CASES 


Configuration 

c 
a 
s 

e 

# 

Model    Structure 
Level  1              Level  2 

Control 
Strategy 

Header  File 

Simulation  of  the 

X-29  Closed-Loop 

Plant 

1 

MIMO 

(Optimal) 

n/a 

cents  trl 

Transfer30hp 

2 

MIMO 
(Limited) 

n/a 

contstrl 

Transfer  301im 

ldentif.  of  the 
Inverse  Plant 

3 

SIMO 
(case*!) 

• 

MISO 
(inv.  case  #1) 

contstrl  &2 

Transferhplinv 

4 

SIMO 
(A4  Plant) 

•  • 

MISO 
(A4inv.Plant) 

contstrl  &  2 

TransferA4inv 

5 

SIMO 
(x-29  Plant) 

MISO 
(x29Inv.Plan) 

contstrl  &  2 

Transferl4inv 

Simulation  of  the 

Existing  Controllers 

and  the  Plant 

6 

MIMO 
(X-29cont.) 
(Optimal) 

MIMO 

(X-29  plant) 

(Optimal) 

corns  tr2 

transferl614hp 

7 

MIMO 

(X-29cont.) 

(Limited) 

MIMO 
(X-29  plant) 
(Limited) 

corns  tr2 

transferl6141im 

8 

Part  I:  closure  of  the  open-loop  model  of  case  #6 
Pan  II:  closure  of  the  open-loop  model  of  case  07 

30th  order  X-29  transfer  function  whose  inverse  is  stable. 

4th  order  A-4D  plant  whose  inverse  is  unstable. 

14th  order  X-29  plant  whose  inverse  is  very  unstable. 
The  closure  implies  the  connection  in  scries  of  the  controller  and  the  plant, 
and  the  intrusion  of  the  negative  feedback  loop  of  gain  1  from  the  plant 
outputs  to  the  controller  inputs. 
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